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ABSTRACT 


This  study  was  undertaken  to  analyze  the  nature  of  oral  French 
proficiency.  From  the  information  obtained  about  the  nature  of  oral 
proficiency,  some  guidelines  were  set  forth  for  evaluating  oral  pro¬ 
ficiency  development  in  learners  of  French  as  a  second  language. 

This  study  has  compared  the  speech  of  three  groups  of  ten  univer¬ 
sity  students  who  were  assumed  to  differ  in  oral  French  proficiency. 

The  group  assumed  to  be  the  least  proficient  was  composed  of  native 
speakers  of  English  who  had  completed  only  one  university  French  course. 
The  second  most  proficient  group  was  composed  of  native  speakers  of 
English  who  had  completed  at  least  two  university  French  courses.  The 
most  proficient  group  consisted  of  native  speakers  of  French  who  had 
completed  at  least  two  university  French  courses. 

In  order  to  elicit  four  one-minute  samples  the  subjects  were 
exposed  to  four  especially  prepared  stimuli.  Two  of  these  were  one- 
minute  monologues  and  two  were  series  of  black  and  white  pictures.  One 
of  the  oral  stimuli  contained  few  structures  of  modification  and  the 
other  contained  many;  they  differed  in  complexity.  An  attempt  was  made 
to  develop  in  the  two  visual  stimuli  a  difference  that  would  elicit 
responses  differing  in  complexity. 

It  was  hypothesized  that  the  three  groups  would  produce  language 
which  did  not  differ  in  (a)  structural  complexity  (b)  rate  of  vocoid  out 
put,  (c)  rate  of  predicate  output,  and  (d)  frequency  of  hesitation. 
Complexity  and  hesitation  were  compared  on  the  basis  of  an  index  which 
related  a  count  of  the  occurrences  with  the  output  in  a  given  production 
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proficiency  but  that  only  output  and  hesitation  vary  with  the  stimuli,, 
Visual  stimuli  were  more  fertile  than  oral  stimuli * 

The  two  non~native  groups  were  not  found  to  be  different  on  the 
variables  measured,, 

On  the  basis  of  frequency 9  four  arbitrarily  selected  grammatical 
classes  and  twenty  pronunciation  elements  were  found  not  to  be  equally 
important  for  communication,,  But  individual  pronunciation  elements  were 
as  important  for  the  beginners  as  for  the  native  speakers* 

The  most  important  conclusions  for  oral  proficiency  evaluation 
concern  the  choice  of  stimuli,  the  weighting  of  various  language  elements, 
and  suggestions  of  evolving 'to  tests  that  are  more  analytic* 
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CHAPTER  I 


‘•Language  most  showeth  a  man; 
speak  that  I  may  see  thee.** 

Ben  Jonson 

THE  PROBLEM 

I.  GENERAL  OBJECTIVES 

The  main  object  of  this  study  is  to  analyze  the  nature  of  oral 
French  proficiency*  Secondarily,  from  the  information  obtained  about 
the  nature  of  oral  proficiency,  it  attempts  to  set  forth  guidelines  for 
evaluating  oral  proficiency  development  in  learners  of  French  as  a  second 
language. 

To  determine  the  nature  of  oral  French  proficiency,  the  study 
compares  in  three  dimensions  one-minute  monologues  spoken  by  groups  known 
to  differ  in  proficiency*  The  dimensions  chosen  are  structural  complexity 
rate  of  output,  and  frequency  of  hesitation. 

The  study  tests  the  constancy  of  complexity,  rate  of  output,  and 
frequency  of  hesitation  by  comparing  speech  produced  in  response  to  four 
different  types  of  stimuli. 

The  investigation  also  considers  three  aspects  of  the  evaluation 
of  pronunciation.  The  purposes  of  the  investigation  of  pronunciation 
were  as  follows: 

1.  to  determine  whether  a  one-minute  monologue  provides  a  wide  enough 
sampling  of  pronunciation  problems  for  evaluation. 

2.  to  find  out  whether  the  scope  of  the  language  of  the  less  proficient 
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speakers  tends  to  be  restricted  to  a  narrower  range  of  pronunciation 
problems. 

3.  to  assess  whether,  on  the  basis  of  frequency,  the  mastery  of  all  pro¬ 
nunciation  problems  is  equally  important. 

The  final  object  of  this  study  is  to  find  out,  on  the  basis  of 
frequency  of  occurrence,  the  relative  importance  of  some  groups  of  syntac¬ 
tical  and  morphological  rules. 

In  summary  then,  the  object  of  this  study  is  to  shed  some  light  on 
the  place  of  structural  complexity,  output,  hesitation,  pronunciation  and 
syntactical  and  morphological  rules  in  the  development  of  oral  French 
proficiency. 


II.  BACKGROUND 

The  need  for  studying  the  nature  of  oral  French  proficiency  is 
great.  If  the  development  of  oral  proficiency  is  to  be  an  important 
aspect  of  language  teachii^,  it  must  also  be  an  important  aspect  of 
language  testing.  But  the  testing  of  the  development  of  oral  proficiency 
depends  upon  the  adequacy  of  the  information  available  about  the  nature 
of  what  is  to  be  tested.  The  evaluation  of  oral  proficiency  requires 
information  about  the  nature  of  its  various  components  and  about  the 
relative  importance  of  these  components. 

Information  about  the  nature  of  oral  French  proficiency  alone  is 
not  adequate,  however,  to  ensure  its  proper  evaluation.  The  tester  must 
select  suitable  techniques  foi;  eliciting  speech.  He  must  be  aware  of  the 
influence*? that  his  choice  of  stimuli  may  have  on  the  nature  of  the  speech 
produced.  Finally  he  must  know  how  to  rate  objectively  the  speech  samples 


*  i.  '  * 

nollmtoaamorsi  io  migftmt  worsao  b  od  be^h^an  ©d  oJ  fcbneJ 

V 

yll&npe  af  a«9i<fo*jq  notJmkonua 

Jo  a  lead  oifJ  no  t  i:>o  nil  oi  ai  y  bird  a  alrfj  Jo  Jos  Ido  larti -*r;r 
fr  /  s  :  :>  '  '  n  -to<  Ctt  A  i  L-  «»:  J  9er-m-y  oo 

no  £  :  -os  bark  cd  a  /bi  te  airii  Jo  dr  ^<f<y  <*rirt  #a*j-f3  y  1 

■ 

i*  j.  2j  -  ,  .  ,  tjl'  o  :c  aoi  [  3 

•Yone ioljoiq 

a:UQ£&oka  .11 

ti  yor  it  lo*  *  3  3  (  Jo  nrj  dan  ail:  •  *  ..  •>  i 

•, 

i  ra  00  oa  i  j.  ■  ,  :$r  ».  9  daaqaa 

. gnijaad  9g*u#i al 

> 

<  .  / 

.adaanoqraoD  szorU  io  Dacadnoq  rai  ^vldnlai 

* . 

■ 


3 


which  he  elicits. 

The  survey  of  literature  which  follows,  first  documents  the  wide¬ 
spread  belief  in  the  importance  of  evaluating  oral  proficiency.  Then  it 
indicates  how  incomplete  and  unclear  the  notion  of  oral  proficiency  is. 
Third,  it  points  out  the  great  diversity  of  opinion  about  the  nature  of 
oral  proficiency  and  about  the  possibility  of  its  evaluation  reflected  in 
the  rating  scales  used.  Fourth,  it  provides  a  list  of  factors  of  profi¬ 
ciency  for  consideration.  Fifth,  it  shows  the  two  points  of  view  held 
about  the  value  of  frequency  counts  to  determine  the  relative  importance 
of  various  classes  of  language  elements.  Sixth,  it  cites  investigations 
which  indicate  that  the  nature  of  speech  was  influenced  by  the  nature  of 
the  stimuli. 

The  Importance  of  Evaluating  the  Development  of  Oral  French  Proficiency 

The  fact  that  not  too  much  is  known  about  the  nature  of  oral  profi¬ 
ciency  and  about  the  construction  of  tests  for  its  evaluation  does  not 
decrease  in  any  way  the  need  to  pay  attention  to  the  oral  skill  in  the 
evaluation  of  language  growth.  The  demands  to  hear  and  speak  a  living 
language  are  much  more  frequent  than  the  demands  to  read  and  write  it. 

The  importance  of  evaluating  the  development  of  the  speaking  skill 
is  paramount,  for,  as  Pimsleur  says: 

The  difference  between  merely  paying  lip  service  to  the  oral 
objective  and  actually  achieving  it  resides  in  making  clear  to  the 
students  that  their  grades  will  depend  to  a  considerable  extent  upon 
their  speaking  performance.1 


1Paul  Pimsleur,  Psychological  Experiments  Related  to  Second 
Language  Learning:  Report  of  the  NDEA  Conference  (Los  Angeles:  University 
of  California,  1959),  p.  194. 
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This  position  is  supported  by  the  Commonwealth  Education  Liaison 
Committee! 

Public  examinations  exert  a  powerful  influence  on  the  framing  of 
curricula  and  methods  of  teaching.  It  is  therefore  of  the  utmost 
importance  that  this  influence  should  be  for  the  better  and  not,  as 
is  often  the  case,  for  the  worse. ^ 

On  the  same  subject  Michael  West  adds! 

Perhaps  the  chief  importance  of  examinations  in  language-work  is 
not  their  effect  in  testing  the  pupils*  learning,  but  their  effect 
upon  the  teachers*  teaching.  •  •  .  Language  is  a  skill;  its  examin¬ 
ation  should  be  a  test  of  ability  to  use  the  language,  but  the 
tendency  is  always  to  make  the  examination  a  Knowledge  examination. 

.  .  •  The  Knowledge  examination  is  easy  to  set,  easy  to  apply,  and 
easy  to  correct,  whereas  tests  involve  a  more  elaborate  technique  in 
setting,  and  in  applying,  and  they  are  more  expensive.-* 

The  consensus  of  an  NDEA  conference  in  1959  on  language  teaching  was 

similar! 

There  is  a  pressing  need  to  evaluate  trainees  in  realistic  terms, 
with  a  justified  weighting  of  their  abilities,  relating  their 
abilities  to  accuracy  of  communication  and  effect  on  the  native 
listener. ^ 

But  the  need  for  a  more  scientific  basis  of  evaluation  still 

i- 

remains.  Lado  states  that  unless  research  in  this  area  is  intense, 

**.  .  •  the  ability  to  speak  a  foreign  language,  though  it  is  the  most 
highly  prized  of  the  integrated  skills,  will  go  largely  untested.**5 


^Commonwealth  Education  Liaison  Committee,  **Tests  and  Examinations 
in  English,**  Teaching  English  as  a  Second  Language.  H.  B.  Allan,  editor 
(New  York!  McGraw-Hill  Book  Co. ,  1965),  p.  393. 

^Michael  West,  **Exami nations  in  a  Foreign  Language,’*  English 
Language  Teaching.  6(1946),  p.  61. 

^Pimsleur,  op.  cit..  p.  28. 

^Robert  Lado,  Language  Testing!  The  Construction  and  Use  of 
Foreign  Language  Tests  (London!  Longmans,  1961),  p.  247. 
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Examples  in  abundance  support  Lado*s  fear  that  the  evaluation  of  the 

speaking  skill  will  continue  to  be  neglected.  West  explains  the  lack  of 

concern  over  the  assessment  of  oral  proficiency  this  ways 

The  real  reason  is  that  (in  many,  if  not  most  countries)  a  consider¬ 
able  proportion  of  the  teachers  do  not  want  a  test  of  ability  to  use 
the  language  because  they  cannot  really  use  it  themselves. 6 

One  need  not  entirely  agree  with  West  but  there  are  three  ways  in 
which  the  disregard  for  oral  proficiency  in  evaluation  has  manifested 
itself.  First,  there  are  those  who  ignore  the  area  completely.  The 
Test  of  English  as  a  Foreign  Language  (TOEFL;  February^  1964  revision) 
is  a  pencil  and  paper  test  aimed  at  evaluating  only  (a)  listening  compre¬ 
hension,  (b)  grammar,  (c)  vocabulary,  (d)  reading  comprehension,  and 
(e)  style. ^  Les  tests  du  b.e.l.c.  completed  in  1966  to  evaluate 
the  linguistic  background  of  immigrants  arriving  in  France  do  not  have  an 
oral  production  section.  The  authors  reason  that  exclusion  of  an  oral 
section  makes  the  test  more  objective  and  economical  of  time.®  There  is 
still  not  one  Canadian  university  that  makes  oral  production  a  mandatory 
part  of  its  language  admission  requirements  even  though  already  in  its 
1929-30  calendar  the  Ontario  College  of  Education  stated  that  ”no  candi¬ 
date  will  be  recommended  for  a  certificate  who  is  not  awarded  50%  of  the 
marks  assigned  to  laboratory  practice  in  Science  or  to  the  oral  practice 

6West,  op.  cit..  p.  61. 

?David  Harris,  ’’English  as  a  Second  Language!  Testing,”  Overseas . 

3,  5 (January,  1964),  p.  25. 

®E.  Companys  et  E.  Francois,  Les  tests  du  b.e.l.c.  (Paris!  Bureau 
d’dtude  et  de  liaison  pour  1 ’enseignement  du  franjais  dans  le  monde, 

1966),  p.  13. 
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in  the  languages.”  In  1964  Sniderman  could  do  no  more  than  urge  his 
readers  to  oral  testing .1° 

In  the  United  States 

...  The  problem  of  oral -aural  tests  received  public  mention  as 
early  as  1919  when  Thomas  S.  Fiske,  Secretary  of  the  College  Entrance 
Examination  Board,  published  a  report  in  which  he  urged  the  desira¬ 
bility  and  discussed  some  of  the  difficulties  of  such  tests. 

And  the  Board  of  Regents  (New  York)  ruled  that  beginning  in  1926  all 

teachers  of  Modern  Languages  must  have  oral  certification  in  the  languages 

in  which  they  give  instruction.*-2  But  Furness  stated  in  1953  that  only 

two  New  York  State  Colleges,  Columbia  and  Cornell  seemed  to  have  followed 

the  recommendations  and  they  had  done  so  for  only  a  small  part  of  the 

students  entering.  The  American  College  Entrance  examination  still  has 

only  an  optional  audio-comprehension  section.1^  Coleman  in  his  1949 

bibliography  on  language  teaching  listed  only  one  item  out  of  800  related 

to  oral  testing. Valette  under  the  heading  ”0ral  Objective  Testing  in 


^W.  C.  Ferguson,  ”Aural  and  Oral -aural  Tests  in  French,”  School, 
XVIII,  8 (April ,  1930),  p.  723. 

*-°M.  Sniderman,  ”Looking  Back  and  Ahead,”  Canadian  Modern  Language 
Review.  20,  4(June,  1964),  pp.  13-16. 

*-*-Edna  L.  Furness,  “Historical  Background  of  Audition  Testing  of 
Spanish,”  Modern  Language  Journal .  13(January,  1953),  p.  23. 

12W.  C,  Decker,  “Oral  and  Aural  Tests  as  Integral  Parts  of  the 
Regents  Examination,”  Modern  Language  Journal .  (1925).  p.  369. 

13Furness,  op.  cit..  p.  124. 

^College  Entrance  Examination  Board,  A  Description  of  the  College 
Supplementary  Achievement  Tests  (Princeton,  N.J.:  College  Examination 
Board,  1963),  p.  5. 

15 

Algernon  Coleman,  An  Analytical  Bibliography  of  Modern  Language 
Teaching,  Vol.  Ill,  1937-42  (New  York:  King’s  Crown  Press,  1949),  p.  365. 
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the  Classroom1* *  somehow  avoids  the  subject  of  oral  production  and  writes 

1  ft 

only  of  aural  tests.  Jones,  describing  a  test  that  he  has  constructed, 
says  that 


•  •  •  the  difficulty  of  the  test  given  in  written  form  is  approxi¬ 
mately  the  same  as  its  difficulty  in  oral  form,  and  that  therefore, 
given  as  a  written  test,  it  is  a  practical  means  of  measuring  the 
pronunciation  of  groups  of  students.*? 

One  could  be  lead  to  similar  conclusions  by  Starr  who  reports  a  correlation 

of  .83  ♦  11.72  between  the  MLA  Proficiency  listening,  reading  and  writing 

tests  and  the  speaking  tests.*® 

The  assumption  implicit  in  this  line  of  action  is  that  one  can 

evaluate  the  speaking  skill  through  the  other  language  skills.  But  it  is 

Lado*s  contention  that: 

There  are  ...  four  skills  the  mastery  of  which  does  not  advance 
evenly.  We  have  thus  four  more  variables  to  be  tested,  namely  the 
degree  of  achievement  in  speaking,  understanding,  reading,  and  writing!^ 

Paterno  appears  to  agree,  because  she  states  that: 

•  •  .  Language  learning  is  a  complex  thing--made  up  of  many  different 
aspects.  ...  It  is  a  mistake  to  think  that  by  measuring  one  aspect 
you  measure  all  others,  that  any  one  aspect  will  give  an  index  to  the 

whole. 20 


*6r.  m.  Valette,  **0ral  Objective  Testing  in  the  Classroom,** 
German  Quarterly.  38(March,  1965),  pp.  179-187. 

^J.  B.  Jones,  ‘’Objective  Testing  of  Pronunciation  at  the  College 
Level,**  Quarterly  Journal  of  Speech.  24(February,  1938),  p.  64. 

*®Wilmarth  W.  Starr,  **MLA  Foreign  Language  Proficiency  Tests  for 
Teachers  and  Advanced  Students,**  PMLA.  77,  4,  part  2(September,  1962), 
pp.  31-37. 

*9Lado,  op.  cit.„  p.  25. 

20Adelaida  Paterno,  ’’Foreign  Language  Testing,”  Teaching  English 
As  a  Second  Language.  H.  B.  Allan,  editor  (New  York:  McGraw-Hill  Book 
Co.,  1965),  p.  378. 
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Agard  and  Dunkel  likewise  concluded  as  a  result  of  their  investigations 

that  each  skill  develops  independently: 

As  to  the  assumption  made  in  some  quarters  that  oral -aural  competence 
automatically  creates  reading  ability  and  that  consequently  the  latter 
need  not  be  specifically  taught ,  there  is  evidence  per  contra  so  far 
as  the  experiments  observed  are  concerned* 21 

Lado,  too,  made  similar  findings: 

The  product -moment  coefficient  between  the  test  of  Aural  Perception 
and  the  test  of  Oral  Production — The  Sound  System  is  .30  ♦  14.  •  •  • 
The  corollary  to  this  relatively  low  correlation  is  that  we  cannot 
use  aural  perception  data  as  a  measure  of  pronunciation;  pronunciation 
has  to  be  measured  separately.22 

A  second  manifestation  of  the  neglect  in  testing  of  oral  profi¬ 
ciency  is  the  attempt  to  use  partial  production  techniques  for  its 
evaluation.  Lado  documented  in  1953  his  claim  to  the  high  correlation 
between  the  results  of  partial  production  and  speaking  tests ,* I 2^  but  the 
validity  of  using  pencil  and  paper  tests  to  evaluate  oral  proficiency  was 
questioned  seriously  by  George  among  others. 2^ 

A  high  correlation  between  the  results  of  tests  of  different 
abilities  has  little  meaning  according  to  Carroll: 

•  •  .  speaking  ability  and  reading  ability  are  logically  quite 


91 

F.  B.  Agard  and  H.  B.  Dunkel ,  An  Investigation  of  Second 
Language  Teaching  (Bostbn:  Ginn  and  Co.,  1948),  p.  291. 

I 

22Robert  Lado,  Measurement  in  English  as  a  Foreign  Language  with 
Special  Reference  to  Spanish-Speaking  Adults  (Unpublished  doctoral 
dissertation.  University  of  Michigan,  1950),  p.  140. 

2-*Lado.  1961,  op.  cit.c  pp.  96-104. 

2 ^-Robert  Lado,  "Test  the  Language,"  Report  of  the  Fourth  Annual 
Round  Table  Meeiting  on  Linguistics  and  Language  Teaching.  A.  A.  Hill, 
editor  (Washington:  Georgetown  University  Press),  4  (September,  1953), p. 30. 

25H.  V.  George,  "Testing ““Another  Point  of  View,"  English  Language 
Teaching .  16(1962),  pp.  72-77. 
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different  kinds  of  performances ,  because  one  can  exist  without  the 
other;  this  is  true  even  though  they  may  be  rather  highly  correlated 
in  a  given  group  of  people  simply  because  this  group  of  learners  had 
common  training  experiences  which  led  them  to  perform  equally  well, 
on  the  average,  on  both  types  of  performance. 26 

The  third  type  of  deficiency  in  our  testing  of  oral  skill  is  only 

mentioned  here  because  it  is  to  be  discussed  in  greater  detail  later  on. 

It  consists  of  singling  out  a  narrow  aspect  of  oral  proficiency,  such  as 

pronunciation,  and  treating  it  as  if  it  were  the  whole  skill.  Keating's 

report  on  the  effectiveness  of  language  laboratories  is  an  outstanding 

example  of  this  misuse  of  tests .27  Sniderman,  who  justifies  his  action 

by  the  lack  of  voice  recording  facilities  for  students,  reports  basing 

oral  evaluation  on  a  reading  pronunciation  test. 2®  Constructive  work  in 

the  development  of  tests  for  only  some  aspects  of  oral  proficiency  is 

likely  to  delay  facing  up  to  the  need  for  more  complete  evaluation  of  oral 

proficiency  by  postponing  a  confrontation  with  the  more  difficult  areas .29 

More  recent  publications  indicate  that  there  has  been  more  activity 

in  the  field  of  oral  testing  since  1945.30  Golby  stated  in  1964  that 


John  Ba  Carroll,  ''Fundamental  Considerations  in  Testing  for 
English  Language  Proficiency,"  Teaching  English  as  a  Second Language » 

H.  B.  Allan,  editor  (New  Yorks  McGraw-Hill  Book  Co.,  1965),  p.  367. 

27Raymond  F.  Keating,  A  Study  of  tt^e  Effectiveness  of  Language 
Laboratories  (New  York:  Institute  of  Administrative  Research,  1963),  p.61. 

28m.  Sniderman,  "Marking  Oral  Work  in  Basic  French,"  Scholastic 
(Secondary  Edition)  28(March,  1940),  pp.  595-597. 

2^Pierre  L6on,  "Les  tests  en  pr ©none i at ion,"  The  Canadian  Modern 
Language  Review.  22,  4(May,  1966),  pp.  16-27;  Paul  Pimsleur,  "Testing  in 
Foreign  Language  Teaching -Speaking  Skill,"  Trends  in  Language  Teaching  * 
Albert  Valdman,  editor  (New  Yorks  McGraw-Hill  Book  Co.,  1966),  p.  200. 

-^Howard  Lee  Nostrand,  David  William  Foster,  and  Clay  Benjamin 
Christensen,  Research  on  language  Teaching.  An  Annotated  International 
Bibliography.  1945-64  (Seattle s  University  of  Washington  Press,  1965). 
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henceforth  the  language  examinations  of  the  British  Secondary  Schools 
Examination  Council  would  allot  25%  of  the  marks  for  oral  prof iciency. 3^ 
Pimsleur  claims  that  there  are  now  "three  tests  of  speaking  proficiency 
•  .  •  which  meet  the  criteria  mentioned,"-^  namely,  validity  ,  reliability, 
ease  of  administration,  and  objectivity  of  scoring.  But  in  spite  of  an 
increasing  general  concern  for  the  evaluation  of  oral  proficiency,  this 
study  attempts  to  show  that  there  are  still  tremendous  gaps  to  be  filled 
in  this  area.  But  even  if  there  are  gaps,  the  assertion  made  in  1929  by 
Henmon  that  "standardized  group  tests  for  pronunciation  and  oral  compo¬ 
sition  which  could  be  administered  widely  seem  almost  impossibilities,"33 
is  no  longer  defensible. 

Definition  Of  Qral ^firofjxienc^ 

The  evaluation  of  oral  proficiency  has  suffered  from  lack  of  a 
clear  and  complete  definition  of  the  term. 

The  investigator  surveyed  the  work  of  the  last  forty  years  in  oral 
testing  to  try  to  gain  a  clearer  understanding  of  what  those  interested 
in  the  field  have  considered  oral  proficiency  to  be.  The  findings  which 
are  summarized  in  Table  I  reveal  an  even  greater  diversity  than  Moses 
found  in  his  survey  of  first  language  speech  tests. 3^ 

31T.  W.  P.  Golby,  "Advances  in  Examination  Techniques,"  Advances 
in  the  Teaching  of  Modern  Languages  0  B.  Lobbish,  editor  (New  York: 
Macmillan,  1964),  p0  131. 

^Pimsleur,  1966,  op«  eit.«  p.  195. 

33V.  A.  C.  Henmon,  Achievement  Tests  in  Modern  Foreign  Languages 
(New  Yorks  Macmillan,  1929),  p.  3. 

34E.  Ro  Moses,  "Survey  of  Speech  Tests  in  Thirty  American  Univer¬ 
sities  and  Colleges ,  1940-41,"  Quarterly  Journal  of  Speech »  28(April, 
1942),  pp.  206-211. 
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It  was  possible  to  group  all  the  proposed  oral  tests  into  the 
following  fourteen  categories: 

1.  Pronunciation  through  repetition  or  reading. 

2.  Production  of  utterances  in  response  to  specific  directions  given 
in  the  first  or  second  language;  for  example,  "Ask  her  if  she  is 
tired. ** 

3.  Transformation  of  one  structure  to  another,  such  as  changing  a 
present  to  a  future  or  a  positive  to  a  negative. 

4.  Substitution  of  one  item  for  another;  for  example,  a  pronoun  for  a 
noun. 

5.  Integration  of  two  structures  into  one;  for  example,  embedding  a 
relative  clause. 

6.  Building  in  echelon;  that  is  to  say,  successively  adding  in  a  cumu¬ 
lative  fashion  several  short  items  to  an  initial  short  utterance. 

7.  Recall  of  a  body  of  previously  learned  language  as  a  result  of  oral 
or  visual  prompting.  (Visual  stimuli  are  either  graphic  or  picto¬ 
rial.) 

8.  Translation. 

9.  Completion  of  a  sentence  or  a  story. 


Legend  for  Table  I 
(  )--year  of  publication 
*  --date  not  available 
l,2--first  or  second  language 
OVS--oral  or  visual  stimuli 
NG  --repetition  or  reading 


EY  --sentence  or  story 
LR  --live  or  recorded  partner 
FC  --free  or  cued 
OVC--oral  or  visual  cue 
X  --proposed,  type  unspecified 
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TABLE  1 

TYPES  OF  ORAL  PRODUCTION  TEST  ITEMS  PROPOSED  BETWEEN  1929  AND  1966 

CLASSIFIED  BY  AUTHOR  AND  TYPE 


Greenleaf  (29) 
Henmon  (29) 
Haley  (41) 
Walker  (41) 
Hudgins  (43) 


Kaulfers  (44)  2 
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4  u 
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1 

2 

1 

2 

1 

1 


Bottke;  Milligan(45)  NG 
Angiolillo  (47) 

Agard;  Dunkel  (48) 
Nevmark  (48) 

Pargment  (48)  G 

West  (52) 


X 

2 

2 


1 

OV  F  0  4 

R  (*,V  0  4 

F,0  2 

OV  L  r.  4 

O  1 


Anderson  (53)  G 
Stabb  (55) 

Sapon  (56)  N 
Yamagiwa  (57)  G 
McCallien;  Taylor (58)  G 
Lambert  (53) (56) (59) 


X 

IX  XX 

X  X  E 


L  C,V  3 

X  F,0  V  3 

XV  4 

X  L  F,0  V  9 

L  2 


X  4 
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TABLE  1  (continued) 
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TABLE  I  (continued) 
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10.  Paraphrasing  a  passage  just  heard  or  read.  (This  differs  from  7 
where  it  is  expected  that  the  language  structure  will  not  be 
different  from  the  model.) 

11.  Conversation  with  a  person  or  a  recording. 

12.  Question  and  answer  with  responses  free  or  cued  by  the  examiner. 
(Oral  or  visual  stimuli  are  used  for  cueing.) 

13.  Monologue  from  oral  or  visual  stimuli. 

14.  Linguistic  reaction  to  a  situation  or  an  utterance. 

The  fourteen  proposed  classifications  are  not  necessarily 
mutually  exclusive.  For  example,  pronunciation  can  be  rated  in  most  of 
the  fourteen  categories.  Paraphrasing  includes  some  recall.  Linguistic 
reactions  abound  in  conversations.  Story  completion  is  a  monologue  for 
which  a  few  sentences  serve  as  stimulus.  Nevertheless  the  classification 
is  useful  because  no  two  categories  are  identical  and  because  this  type 
of  classification  does  help  one  to  discover  basic  conflicts  in  the  per¬ 
ception  of  the  nature  of  proficiency. 

Categories  1  to  10  differ  from  11  to  14  in  the  degree  of  lin¬ 
guistic  control  that  the  examiner  can  impose  on  the  examinee.  In 
categories  1  to  10,  it  is  possible  to  force  the  subject  to  produce  what¬ 
ever  item  is  selected  for  testing  but  in  categories  11  to  14  the  examinee 
would  find  it  easier  to  skirt  a  problem  area,  thus  tending  to  thwart  the 
most  diligent  efforts  of  the  examiner.  The  survey  revealed  that  nine  out 
of  fifty-three  designers  of  tests  did  not  consider  it  necessary  to  use 
techniques  in  the  1  to  10  group  while  nine  other  designers  of  tests  felt 
likewise  about  the  11  to  14  group.  In  other  words,  of  the  fifty-three 
surveyed,  nine  testers  implied  that  it  was  possible  to  judge  proficiency 
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from  a  series  of  objective  precise  observations  and  nine  implied  that 
global  impressions  were  more  representative  of  proficiency.  Global 
impressions  seem  to  be  gaining  in  popularity  since  the  nine  reported  were 
published  between  1961  and  1965.  But  more  important,  the  overwhelming 
majority  of  the  test  designers  implied  that  a  complete  evaluation  of  oral 
proficiency  would  include  proof  of  ability  to  handle  a  series  of  indi¬ 
vidual  problems  predetermined  by  interlanguage  contrastive  analysis  as 
well  as  proof  of  an  integrated  facile  performance. 

There  is  also  common  agreement  upon  the  necessity  of  evaluating 
mastery  of  specific  pronunciation  problems.  The  reading  or  repetition 
pronunciation  test  technique  was  the  most  popular  of  the  fourteen  tech¬ 
niques  (35  out  of  53).  The  ease  of  preparation,  administration  and 
scoring  of  this  type  of  item  may  account  for  its  popularity  as  much  as 
conviction  about  its  importance.  One  should  keep  in  mind  the  fact  that 
many  tests  use  the  other  techniques  too  for  rating  pronunciation. 

Conversation,  question,  and  monologue  are  the  next  three  most 
frequent  techniques.  Of  the  152  choices  made  by  the  53  test  designers 
surveyed,  62  are  either  conversation,  question,  or  mcnologue.  Here  again 
is  an  indication  of  the  general  belief  in  the  necessity  of  evaluating  the 
integrated  speaking  skill  in  spite  of  the  problems  of  scoring  that  these 
techniques  pose.  The  belief  that  these  techniques  approach  a  real-life 
situation  may  also  explain  their  popularity. 

The  next  most  popular  technique  is  giving  direct  ions  that  will 
cause  the  subject  to  give  a  specific  response  (13  out  of  53).  Nine  of 
the  techniques  have  gained  only  token  acceptance  ranging  from  7  to  1  out 
of  a  possible  53,  well  below  a  mean  acceptance  of  10.8.  Translation  is 
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proposed  by  only  3  out  of  53, 

The  survey  also  revealed  a  wide  range  in  the  number  of  techniques 
accepted  by  individual  test  designers.  This  wide  range  is  represented 
diagrammatic ally  in  Figure  1.  Fourteen  designers  of  tests  proposed  only 
one  technique,  thirteen  proposed  only  two,  nine  proposed  only  three  ,  and 
eleven  proposed  only  four.  A  few  suggested  a  great  variety.  Two  desig¬ 
ners  suggested  five  techniques,  one  suggested  six  techniques,  one  sug¬ 
gested  eight,  and  two  suggested  nine.  The  average  number  of  techniques 
by  each  examiner  is  2.85. 

The  preference  for  a  small  number  of  techniques  revealed  by  the 

survey  is  an  indication  that  the  concept  of  sampling  the  whole  inventory 

of  problems  proposed  by  Lado33  has  not  been  unanimously  popular.* *  3^ 

Several  test  designers  agree  with  Carroll  who  said: 

I  recommend  tests  in  which  less  attention  is  paid  to  specific 
structure  points  or  lexicon  than  to  the  total  communicative  effect 
of  an  utterance.  .  •  .Indeed  the  overconscientious  use  of  the 
bilingual  comparison  axiom  could  lead  to  different  tests  of  English 
proficiency  for  each  native  language  group,  and  a  virtual  impossi¬ 
bility  of  establishing  common  standards  of  English  language 
proficiency  across  native  language  groups. 37 

Carroll  prefers  the  '* integrative”  approach  because  it  (1)  entails  more 

diffuse  sampling,  (2)  depends  less  upon  the  specifics  of  a  particular 

course,  (3)  makes  the  difficulty  of  the  linguistic  task  subjectively  more 

obvious  to  the  evaluator  and  (4)  makes  contrastive  analysis  less 

O  Q 

necessary. 

33Lado,  1953,  op,  cit .  „  p»  30. 

36 J.  A,  Upshur,  "Language  Proficiency  Testing  and  the  Contrastive 
Analysis  Dilemna,"  Language  Learning, 12,  2(1962),  pp,  123-128. 

3^Carroll,  1965,  op,  cit , ,  pp,  369-370. 


38Ibid. ,  p.  370. 
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Within  each  of  these  fourteen  classifications  are  hidden  other 
differences.  Some  testers  use  both  oral  and  visual  stimuli  apparently 
because  they  are  aware  of  the  interference  of  the  graphic  symbol ,  of  the 
assistance  of  the  spoken  symbol ,  and  of  the  vagueness  and  linguistic 
remoteness  of  the  pictorial  stimuli#  Others  have  selected  either  the 
the  oral  or  the  visual ,  and  are  apparently  unconcerned  about  the  influence 
of  the  stimuli  upon  oral  production. 

Other  important  differences  are  found  in  giving  directions  in  the 
first  or  second  language,  in  submitting  the  examinee  to  a  conversation 
within  the  rigid  framework  of  a  recording  as  opposed  to  human  response, 
or  in  allowing  or  refusing  full  freedom  in  the  selection  of  material  for 
answering  a  question. 

In  summary,  therefore,  it  can  be  said  that  a  survey  of  proposed 
and  existing  tests  reveals  a  great  diversity  of  opinions  about  what  are 
satisfactory  techniques  for  evaluating  the  development  of  oral  pro¬ 
ficiency.  And  since  not  all  techniques  are  equally  suitable  for  evalu¬ 
ating  every  aspect  of  oral  proficiency,  the  diversity  revealed  by  the 
survey  indicates  a  lack  of  agreement  about  the  nature  of  oral  proficiency. 
The  diversity  also  points  to  a  lack  of  agreement  about  what  are  the  most 
effective  methods  to  cause  proficiency  to  be  demonstrated. 

Sufficiency,  accuracy,  and  fluency  are  the  three  terms  used  by  the 

on 

American  Department  of  State  to  describe  oral  proficiency.  7  Carton  uses 
the  terms  "comprehensibility”  and  "pleasantness".^  Twaddell  breaks  it 

■^^H.  Cleveland,  G.  J.  Mangone,  and  J.  C.  Adams,  The  Overseas 
Americans  (New  Yorks  McGraw-Hill  Book  Co.,  1960),  pp.  250-251. 

^°Carton,  op.  cit».  p.  11. 
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down  into  accuracy  and  fluency.^3-  Dodson  describes  it  by  this  formula 
Proficiency  «=  number  of  words  x  10  X  1  ♦  deviation  from  average  number  of  W 

He  calls  the  500  in  the  denominator  a  fluency  factor.  Pimsleur  analyses 
accuracy  into  words  for  concrete  objects  and  abstractions,  pronunciation 
and  syntactic  patterns  and  describes  fluency  as  ease  in  thought  expression^ 
This  differs  little  from  Yamagiwa’s  enumeration  of  components?  pronun¬ 
ciation,  accentuation,  intonation,  vocabulary,  grammar,  and  readiness  in 
expression  and  response.^  Lado’s  definition  is  somewhat  more  complete, 
describing  oral  proficiency  in  these  terms! 

.  •  .  the  ability  to  use  in  essentially  normal  communication  situ¬ 
ations  the  signaling  systems  of  pronunciation,  stress  intonation, 
grammatical  structure,  and  vocabulary  of  the  foreign  language  at  a 
normal  rate  of  delivery  for  native  speakers  of  the  language. ^ 

However,  proficiency  is  not  the  ability  to  express  complex 
abstractions  because  few  native  adult  speakers  have  this  ability.  It  is 
rather  the  ability  to  express  through  speech  such  thoughts  and  concepts 
as  are  reasonable  for  the  intellectual  capacity  of  the  subject. ^  A 
measurement  of  proficiency  is  in  no  sense  a  measurement  of  all-embracing 

^Twaddell,  op.  cit.«  pp.  6-7. 

^Dodson,  op.  cit.»  pp.  4-5. 

^Paul  Pimsleur,  "French  Speaking  Proficiency  Tests,"  French 
Review.  34  (April,  1961),  pp.  470-479. 

^Joseph  K.  Yamagiwa,  "A  Check-list  of  Tests  for  Various  Types 
of  Proficiency  in  a  Foreign  Language,"  Language  Learning,  7 ,  3  &  4 
(1956-57),  pp.  99-124. 

^Lado,  1961,  op.  cit.«  p.  241. 

46b,  M.  Bazan,  "The  Danger  of  Assumption  Without  Proof,"  Modern 
Language  Journal «  48(October,  1948),  p.  338. 
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intellectual  competence.  It  cannot  even  begin  to  sound  "ante”  and  "post¬ 
language"  intellectual  activity,^  In  Chomsky® s  distinction  between 
competence  and  performance  or  de  Saussure*s  distinction  between  langue 
and  parole,  proficiency  is  performance  or  parole. ^  it  is  not  a  complete 
reflection  of  competence  because  of  memory  limitations,  distractions, 
shifts  of  attention,  and  errors  that  don't  result  from  lack  of  linguistic 
competence.  It  has  to  be  described  in  terms  of  norms  because  there  are 
different  standards  of  performance  for  individual  speakers --all  of  which 
may  be  considered  of  native  quality.  The  quality  of  performance  of  the 
individual  may  fluctuate  from  one  situation  to  another. 

The  Need  for  More  Objectivity  in  Evaluating  Oral  Proficiency 

It  is  shown  in  the  preceeding  section  that  there  is  lack  of  agree¬ 
ment  about  the  techniques  most  appropriate  for  eliciting  oral  production 
and  consequently  about  the  aspects  of  oral  production  that  need  to  be 
taken  into  consideration  to  arrive  at  a  valid  evaluation  of  oral  pro¬ 
ficiency.  The  same  lack  of  unanimity  is  revealed  in  an  informal  survey 
of  rating  scales  done  by  the  investigator.  Sixteen  samples  that  were 
selected  for  the  diversity  they  represent  are  summarized  in  the  following 
list: 

1.  Walker  (1941)  rates  proficiency  globally  on  a  five-point  scale. 

2.  Kaulfers  (1944)  classifies  proficiency  into  four  levels:  (1)  unintel- 

^J.  de  Ajuriaguerra  and  others,  Problemes  de  psychol inguistique- 
svmposlum  de  1 'association  de  psvchologie  scientifjque  de  langue  frangaise 

(Paris:  Presses  universitaires  de  France,  1963),  pp.  51-72. 

^^Noam  Chomsky,  Syntactic  Structures  (The  Hague:  Mouton  and  Co., 
1965).  pp.  3-4, 
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ligible  (2)  partially  intelligible  (3)  intelligible  but  labored 

(4)  readily  intelligible® 

3.  Agard  and  Dunkel  (1948)  distinguish  three  levels  of  proficiency! 

(1)  ability  to  report  a  single  act  or  situation  (2)  ability  to  express 
a  sequence  of  ideas  fluently  (3)  ability  to  converse. 

4.  Yamagiwa  (1955-1956)  rates  each  of  (1)  pronunciation  (2)  correctness 
of  vocabulary  and  grammar  (3)  fluency  on  a  five-point  scale. 

5.  Bueckel  (1957)  describes  the  following  five  levels  of  proficiency: 

(1)  must  resort  to  first  language  and  gestures  (2)  follows  verbal 
translation  (3)  intelligible  but  vocabulary  limited  (4)  good 
expression  (5)  full  command. 

6.  Harris  (1961)  rates  on  a  five-point  scale  (1)  pronunciation 

(2)  grammar  and  word-order  (3)  vocabulary  (4)  speed  (5)  sentence 
length  as  demonstrated  in  a  ten-minute  conversation. 

7.  Palmer  (1961)  rates  pronunciation  and  fluency  on  a  five-point  scale. 

8.  FLES  (1962)  names  the  following  five  levels  of  proficiency: 

(1)  serious  mistakes  (2)  slight  mistakes;  subject  requires  prompting 

(3)  no  mistakes;  subject  requires  prompting  (4)  slight  mistakes 

(5)  no  mistakes. 

9.  Starr  (1962)  gives  the  MLA  Statement  of  Qualifications  for  Secondary 
School  Teachers  of  Modern  Foreign  Languages.  It  provides  a  lengthy 
description  of  how  one  would  distinguish  the  following  three  levels: 
(1)  minimal  (2)  good  (3)  superior. 

10.  British  Columbia  Department  of  Education  (1963)  rates  content  and 
correctness  on  a  twenty-point  scale. 

11.  Foreign  Service  Institute  (1963)  uses  a  five-point  rating  of 
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(1)  accent  (2)  grammar  (3)  vocabulary  (4)  fluency  (5)  comprehension! 

12.  MLA  Cooperative  Language  Tests  (1963)  use  a  five-point  rating  of 
(1)  meaningfulness  (2)  naturalness  (3)  correctness. 

13.  Guerra s  Abrahamson,  and  Newmark  (1964)  use  the  scale  proposed  by 
Kaulfers  in  1944. 

14.  Scherer  and  Wertheimer  (1964)  rate  pronunciations,  morphology  and 
syntax  in  a  directed  utterance  on  a  five-point  scale;  pronunciation 
morphology,  syntax,  and  vocabulary  in  free  responses  on  an  eight- 
point  scale;  and  intonation  on  an  eight-point  scale. 

15.  MLA  Proficiency  Tests  (1964)  contain  a  five-point  rating  of 

(1)  vocabulary  (2)  pronunciation  (3)  structure  (4)  fluency  which 
accounts  for  more  than  60%  of  the  total  score. 

16.  Le  ministere  des  affaires  exterieures  du  Canada  (1966)  rates  pro¬ 
ficiency  globally  on  a  four-point  scale. 

The  scales  vary  from  three  to  twenty  in  their  number  of  gradations. 
The  five-point  scale  is  the  most  popular.  The  ratings  are  for  qualities 
such  as  proficiency,  intelligibility ,  type  of  situation  handled,,  pronun¬ 
ciation,  correctness  of  vocabulary  and  grammar,  fluency,  speed,  nearness 
to  the  first  language,  content,  meaning fulness ,  and  naturalness. 

The  following  attempt  by  Guenot  to  justify  his  classification  of 
oral  proficiency  into  three  levels  is  typicals 

l 

Insistons  sur  les  trois  etages  d’acquisitions  seuls  ils  nous 
permettent  de  definir  le  type  de  connaissance  et  d’aisance  a 
pratiquer  la  langue  que  possedent  les  sujets.  Lorsqu’un  schema  est 
repete  correctement  et  correctement  situe  dans  son  contexte ,  le 
premier  etage  est  assure.  Lorsque  les  sujets  sont  capables  de  faire 
convenablement  la  substitution  a  partir  d°une  solicitation  auditive 
qui  sert  d®amorce,  qu5elle  soit  ou  non  accompagnee  d0une  solicitation 
visuelle,  le  deuxieme  etage  est  en  place.  Lorsque,  a  partir  d’une 
image  ou  d*une  question  ouverte,  les  sujets  sont  capables  de  parler 


' 
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correctement  pendant  quelques  phrases ,  le  troisieme  dtage  est  en 
place.49 

On  aura  sans  doute  deja  compris  que  ces  trois  etages  sont  des  niveaux 

qui  permettent  de  caracteriser  le  progres  dans  l9 aptitude  a  manipuler 

la  langue  0  «  00  Le  subjonctif  fran?ais  n’est  pas  plus  de  troisieme 

etage  que  les  pronoms  personnel s0  Chaque  etage  correspond  a  un  palier 

dans  1 ’edification  d’une  pratique  corrected  d’une  tournure  de  la 

langue  a  apprendres  au  premier 9  on  la  repete  pour  bien  l’articuler 

et  la  memoriser;  au  deuxieme,  on  substitue  a  divers  endroits  de  la 

phrase  des  mots  d’un  paradigme  equivalent ,  afin  d'en  bien  analyser 

et  d’en  connaitre  mecaniquement  le  schema;  au  troisieme  etage  on 

est  capable  de  produire  cette  phrase 9  ou  toute  autre  equivalente  du 

point  de  vue  du  sens,  dans  une  forme  correcte9  appropriee,  et  qui 

peut  etre  tres  sensiblement  differente  de  la  stimulation  initiale 

SO 

(question  ou  autre) 

The  question  of  why  the  characteristics  selected  for  each  level 
are  more  important  than  others  that  are  ignored  is  left  unanswered..  The 
question  of  why  proficiency  is  classified  into  three  rather  than  into 
another  number  of  levels  is  not  answered  satisfactorily  either..  And 
finally  if  the  classifications  proposed  are  the  ’’right”  ones9  how  can  an 
evaluator  be  sure  of  classifying  a  language  sample  properly? 

All  these  scales  call  for  qualitative  and  subjective  judgments., 
Until  technology  is  able  to  produce  equipment  capable  of  scoring  speech, 
speech  (except  for  the  few  facts,  such  as  rate  of  production,  that  are 
quantifiable)  will  have  to  be  evaluated  subjectively,  and  this  even 


49 

Jean  Guenot,  Pedagogie  audio-visuelle  des  debuts  de  1 ’anglais 
(Editions  Sabri ,  1964) 9  p0  2340 

*^Jean  Guenot 9  Cles  pour  les  langues  vivantes  (Editions  Seghers, 
1964),  p0  165o 

51Harlan  Lane  and  Roger  Buiten,  ”A  Self “Instruct ional  Device  for 
Conditioning  Accurate  Prosody,”  Trends  in  Language  Teaching.,  Albert 
Valdman,  editor  (New  Yorks  McGraw=Hill  Book  Coe ,  1966),  pp0  159=174; 

D.  Bo  Fry  and  P.  Denes,  ’’The  Solution  of  Some  Fundamental  Problems  in 
Mechanical  Speech  Recognition,”  Language  and  Speech «  1(1958),  ppo  35=58. 
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when  the  marker  focuses  attention  on  one  specific  fact  and  marks  it 
either  right  or  wrong.  Evaluation  of  speech  must  now  be  mostly  subjective 
and  the  course  of  action  open  is  to  reduce  subjectivity  where  it  cannot  be 
removed  entirely.  Subjectivity  can  be  reduced  by  using  only  a  two- point 
scale, 52  by  describing  precisely  the  language  facts  or  qualities  to  be 
evaluated,  and  by  focusing  attention  on  one  fact  at  a  time. 53  According 
to  Lado,  five-point  scales,  to  say  nothing  of  twenty-point  scales,  are 
likely  to  be  unreliable.  But  Bryan  has  provided  evidence  of  the  high 
reliability  of  the  five-point  scales  used  in  the  Modern  Language 
Association  Cooperative  and  Proficiency  Tests, ^ 

The  problems  of  reliability  in  the  rating  of  speech  will  remain 
difficult  even  with  the  assistance  of  statisticians.  If  reliability  is 
more  difficult  to  obtain  in  making  global  judgments  of  such  qualitative 
characteristics  as  intel legibility  and  naturalness,  one  avenue  of  progress 
would  be  found  in  breaking  down  these  general  terms  into  their  components 
in  order  to  obtain  a  more  precise  description  of  the  nature  of  proficiency. 
At  the  present  too  many  scales  require  the  evaluator  to  define  various 
degrees  of  proficiency  without  having  provided  a  precise  definition  of 
the  nature  of  proficiency. 

■^G.  Mialaret  et  C.  Malandain,  Test  C.G.M.  62  pour  apprecier  le 
niveau  des  connaissances  iinguistiques  CREDIF  (Paris:  Didier,  1962), 
pp.  13-32. 

53Lado,  1961,  op,  cit,.  pp.  29-80. 

-^Miriam  M.  Bryan,  "The  MLA  Cooperative  Foreign  Language  Tests — 

An  Innovation  in  Foreign  Language  Testing,"  The  Bulletin  of  the 
Pennsylvania  State  Modern  Language  Association.  43,  2(April,  1965), 
pp.  99-100. 
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The  Need  to  Identify  Factors  of  Oral  Proficiency 

Assumptions  are  made  about  factors  that  contribute  to  proficiency 

but  little  evidence  is  available  as  to  the  relative  importance  of  the 

factors  in  proficiency.  According  to  their  inclinations,  individual 

evaluators  may  be  more  highly  impressed  by  certain  factors  than  by  others. 

In  the  tests  that  require  both  controlled  and  free  responses,  an  evaluator 

may  base  his  evaluation  on  the  same  factor  in  both  types  of  performances 

(e.g.  certain  allophonic  qualities)  and  pay  little  attention  to  others 

that  are  equally  or  more  important.  Test  constructors  are  frequently 

content  to  demonstrate  scorer  and  interscorer  reliability  important  as 

that  may  be. 55  Little  is  said  about  the  validity  of  the  scores.  In 

short  any  lay  native  speaker  can  distinguish  between  the  most  and  least 

proficient,  but  even  the  professional  finds  it  hard  to  state  in  precise 

terms  what  is  the  nature  of  the  proficiency  he  recognizes.  Proficiency 

has  not  been  defined  in  operational  terms. 

What  seems  to  be  needed  before  we  can  make  significant  improvements 
in  our  tests  in  the  way  of  weighting  various  aspects  of  language 
learning  in  an  equitable  way,  is  a  series  of  detailed  factorial 
studies  that  would  tell  us  what  aspects  are  differentiable. 56 

What  we  must  establish  is  the  degree  to  which  various  linguistic 
components  .  .  •  contribute  to  the  naive  layman’s  very  valid 
impression  of  fluency,  grammatical  accuracy,  stylistic  congruity, 

and  accent. 5 7 


55Miriam  M.  Bryan,  ”MLA  Foreign  Language  Proficiency  Tests  for 
Teachers  and  Advanced  Students The  DFL  Bulletin.  5,  1  (October),  p.  5. 

56paula  Thibault,  ”  Implications  of  Experience  with  College  Board 
Language  Tests,”  Report  of  the  Fourth  Annual  Round  Table  Meeting  on 
Linguistics  and  Language  Teaching.  A.  A.  Hill,  editor  (Washington: 
Georgetown  University  Press),  4(September»  1953),  p.  25. 

57Albert  Valdman,  "Programmed  Instruction  and  Foreign  Language 
Teaching,”  Trends  in  Language  Teaching.  Albert  Valdman,  editor  (New  York: 
McGraw-Hill  Book  Co.,  1965),  p.  138. 
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Three  commonly  recognized  factors  of  proficiency  are  (1)  language 
complexity,  (2)  rate  of  output,  and  (3)  pronunciation*  Frogner,  Davis, 
Smith,  Miller,  Piaget,  Strickland,  Loban,  and  Labrant,  all  concluded 
from  their  observations  that  as  a  child°s  first  language  develops  he  uses 
more  compound  and  complex  sentences .58  Studies  showing  a  parallel  develop¬ 
ment  of  language  complexity  in  the  adult  learner  are  lacking*  Mialaret 
and  Malandain  weight  rate  of  output  heavily  toward  complexity  but  con- 
trarily  to  Loban  they  consider  linking  verbs  as  contributing  negatively 
to  complexity. J  Thorndike,  on  the  other  hand,  concluded  from  his 
observations  of  adults  that  the  language  complexity  of  a  person  fluc¬ 
tuated  sufficiently  to  be  meaningless.^  Because  the  rate  of  output  is 
a  readily  observable  and  a  measurable  aspect  of  language,  it  has  been 


^Ellen  Frogner,  "Problems  of  Sentence  Structure  in  Pupils* 
Themes,"  The  English  Journal.  22 (November ,  1933),  pp.  743-744; 

E.  A,  Davis,  Linguistic  Skill  in  Twins*  Singletons  with  Siblings*  and 
Only  Children  from  Age  5  to  10  Years  (Institute  of  Child  Welfare 
Monograph  Series,  No.  14) (Minneapolis J  University  of  Minnesota  Press, 
1937);  M.  E.  Smith,  "Some  Light  on  the  Problem  of  Bilingualism  as 
Found  from  a  Study  of  the  Progress  in  the  Mastery  of  English  among 
Preschool  Children  of  Non-American  Ancestry  in  Hawaii,"  Genetic 
Psychological  Monograms*  21(1939),  p.  268;  G.  A.  Miller,  Language 
and  Communication  (New  York:  McGraw-Hill  Book  Co.,  1951),  p.  150; 

Jean  Piaget,  Le  langage  et  la  pensee  chez  l*enfant  (Neuchatel ,  Suisse: 
Delachaux  et  Niestle,  1962),  p.  29;  Ruth  G.  Strickland,  "The  Language 
of  Elementary  School  Children:  Its  Relationship  to  the  Language  of 
Reading  Textbooks  and  the  Quality  of  Reading  of  Selected  Children," 
Bulletin  of  School  Education.  38,  4 (Blooming ton:  Indiana  University, 

1962) ,  p.  61;  Walter  D.  Loban,  The  Language  of  Elementary  School 
Children  (Champaign,  Illinois:  National  Council  of  Teachers  of  English, 

1963)  j  p.  61;  Lou  Labrant,  "A  Study  of  Certain  Language  Developments 
of  Children  in  Grades  4-12  Inclusive,"  Genetic  Psychology  Monographs. 
14,  4(1933),  pp.  415-475. 

~^G.  Mialaret  et  C.  Malandain,  op.  cit . .  pp.  13-22. 

60E.  L.  Thorndike,  Studies  in  the  Psychology  of  Languages 
(New  York:  Appleton,  Century,  Crofts,  1938). 
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considered  and  used  frequently.  Young ,  Fries*  McCarthy*  Lambert,  The 
American  Language  Institute*  Carroll,  American  University  Language  Center, 
Marty,  Dodson,  and  Calv^t  proposed  a  count  of  word  output  as  a  measure¬ 
ment  of  proficiency.61  Mialaret  and  Malandain  count  "ideas'*.62 

There  are  those  who,  on  the  other  hand,  suggest  that  rate  of  out¬ 
put  is  not  an  important  factor  of  proficiency. 

Speed  of  speech  is  a  different  matter  for  the  hearer  and  speaker.  As 
a  hearer,  one  must  follow  the  flow  of  language  at  a  speed  determined 
by  the  person  to  whom  one  is  listening.  As  a  speaker,  one  can  choose 
his  own  rate  of  speed.  The  learner  must  listen  as  fast  as  the  native 
speaker  is  accustomed  to  talk.  But  as  a  speaker  he  is  well  advised 
not  to  try  to  equal  the  speed  of  the  native  speaker.  He  has  nothing 
to  lose  by  being  deliberate.6-* 


61F.  M.  Young,  "An  Analysis  of  Certain  Variables  in  a  Develop¬ 
mental  Study  of  Language,"  Genetic  Psychology  Monographs.  23(1941), 
p.  127;  Charles  C.  Fries,  The  Structure  of  English  (New  York:  Harcourt , 
Brace  and  World,  Inc.*  1952),  p.  291;  Dorothea  McCarthy,  "Language 
Development  in  Children,  "  A  Manual  of  Child  Psychology.  Leonard 
Carmichael,  editor  (New  Yorks  Wiley,  1954),  pp.  542-  544;  Wallace  E. 
Lambert,  J.  Havelka,  and  R.  C.  Gardner,  "Linguistic  Manifestations 
of  Bilingualism,"  American  Journal  of  Psychology.  72(1959),  p.  80; 

The  American  Language  Institute,  Oral  Rating  Form  for  Rating  Language 
Proficiency  in  Speaking  and  Understanding  English  (Washington,  D.C.: 
Georgetown  University,  1960);  John  B.  Carroll*  "A  Factor  Analysis  of 
Verbal  Abilities,"  Psvchometrika.  6(1941),  pp.  296,  299;  John  B.  Carroll 
"Problems  of  Testing  Language  Instruction.  Some  Principles  of  Language 
Testing,"  Report  of  the  Fourth  Annual  Round  Table  Meeting  on  Linguistics 
and  Language  Teaching.  A.  A.  Hill,  editor  (Washingtons  Georgetown 
University  Press),  4(September*  1953)*  p.  8;  The  American  University 
Language  Center,  "Instructions  for  Rating  Aural/Oral  Proficiency  in 
English  Using  the  AULC  Interview  Rating  Form,"  English  Testing  Guidebook. 
Part  I .  Melvin  J.  Fox  and  Davis  Harris,  editors,  English  as  a  Second 
Language:  Development  and  Testing  (Ford  Foundation  reprint  from  Overseas) 
3,  5 (January,  1964);  Fernand  Marty,  Programming  a  Basic  Foreign  Language 
Course:  Prospects  for  Self-Instruction  (Roanoke*  Va.:  Audio-visual 
Publications,  1962),  p.  3;  C.  J.  Dodson,  Oral  Examinations  (Aberystwyth, 
Wales:  Faculty  of  Education,  University  College  of  Wales,  1963),  p.  4; 

M.  M.  Calvet ,  L*enseignement  du  francais  en  Africue.  IV-A.  Le  francais 
parle.  Etude  phonetioue.  Interferences  du  phonetisme  Wolof  (Dakar, 
Senegal:  Centre  de  linguistique  appliquee*  1964),  p.  9. 

6^Mialaret  et  Malandain*  op.  cit » „  pp.  13-22. 

63Nelson  Brooks,  "Conspectus  for  the  Preparation  of  Materials  and 
Tests  for  Instruction  in  Foreign  Language  Proficiency,"  (New  Haven:  Yale 
University,  1959),  mimeo. 
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Another  factor  which  seems  deceptively  easy  to  observe  is  the 
quality  of  pronunciation.  This  may  be  due  in  part  to  the  small  number  of 
phonemes  in  the  sound  system  of  a  language.  And  as  was  shown  earlier, 
many  designers  of  tests  were  of  the  impression  that  rating  pronunciation 
was  rating  speech.  The  following  are  a  few  of  those  who  gave  attention 
to  rating  pronunciation:  Delattre,  Lado,  American  Language  Institute, 
American  University  Language  Center,  Moulton, Dodson,  and  Carton.6^ 

Among  the  other  factors  not  proposed  as  frequently  (4)  hesitation 
is  found.  It  is  believed  by  some  to  be  just  a  negative  correlate  of 

rate  of  production.  It  may  also  be  considered  to  be  more  a  psychological 
than  a  linguistic  manifestation. 

(5)  Sentence  length  is  considered  to  be  a  reliable  predictor  of 


/  / 

^Pierre  Delattre,  "Testing  Student’s  Progress  in  the  Language 
Laboratory,"  International  Journal  of  American  Linguistics.  F.  J.  Oinas, 
editor  (Bloomington,  Indiana:  University  of  Indiana,  1960)  26,  4  (October, 
1960),  pp,  77-98;  Pierre  Delattre,  Comparing  the  Phonetic  Features  of 
English.  French.  German,  and  Spanish  (Heidelberg:  Julius  Groos  Verlag , 
1965);  Robert  Lado,  "Phonemics  and  Pronunciation  Tests,"  Modern  Language 
Journal,  35(1951),  pp.  531-542;  Robert  Lado,  "Phonemics  and  Pronunciation 
Tests,"  Modern  Language  Journal ,  40(1956),  pp.  335-345:  The  American 

Language  Institute,  op.  cit.;  The  American  University  Center,  op.  cit.; 

W.  G.  Moulton,  "Toward  a  Classification  of  Pronunciation  Errors,"  Modern 
Language  Journal .  46(March,  1962),  pp.  101-109;  Dodson,  op.  cit.; 

Aaron  S.  Carton,  Rating  Speech--Manv  Considerations.  Some  Data  (New  York: 
New  York  University  School  of  Education,  Experimental  Teaching  Center, 
1964),  mimeo. 

^L,  E.  Travis,  W.  Johnson,  and  J.  Shover,  "The  Relation  of 
Bilingualism  to  Stuttering,"  Journal  of  Speech  Disorders.  2  (1937), 
pp.  185-189;  Freida  Goldman-Eisler ,  "The  Predictability  of  Words  in 
Context  and  the  Length  of  Pauses  in  Speech,"  Language  and  Speech.  1  (1958), 
pp.  226-231;  Howard  Maclay  and  Charles  E.  Osgood,  "Hesitation 
Phenomena  in  Spontaneous  English  Speech,"  Word .  15  &  16  (1959-60), 
pp.  19-44;  Jane  Blankenship  and  Christian  Kay,  "Hesitation  Phenomena  in 
English  Speech:  A  Study  in  Distribution,"  Word,  19  6c  20  (1963-  64), 
pp.  360-372. 
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proficiency.66  Carroll,  Mackey,  and  Marty  proposed  that  (6)  speed  of 

reaction  is  one  also,but  Loban  and  Lambert  reached  the  opposite  conclusion^7 

Mialaret  and  Malandain,  Dodson,  and  The  American  University 

Language  Center  consider  grammatical  (7)  correctness  in  their  ratings  of 
68 

proficiency.  The  American  Language  Institute  and  Braine  proposed 
control  of  (8)  syntax  as  a  factor. 

Fries  proposed  that  the  choice  of  (9)  words  was  a  factor.  The 
American  University  Language  Center,  The  American  Language  Institute, 

Carroll  and  those  like  Gougenheim  who  have  developed  word  lists  would 
certainly  agree  that  vocabulary  plays  an  important  role  in  proficiency.70 


^6Fries,  op.  cit..  p.  291;  McCarthy,  op.  cit..  p.  544-545; 

The  American  Language  Institute,  op.  cit.;  Walter  Loban,  Language 
Ability  in  the  Middle  Grades  of  the  Elementary  School.  Final  Report 

to  USOE  (University  of  California,  1961),  p.  131;  R.  W.  Brown  and 
Ursula  Bellugi,  "Three  Processes  in  the  Child's  Acquisition  of  Syntax," 
Harvard  Educational  Review.  34,  2(1964),  p.  134;  Carton,  op.  cit..  p.  15; 

^7Carroll,  1953,  op.  cit..  p.  9;  Fernand  Marty,  "Objectivity  and 
the  Foreign  Language  Teacher,"  International  Journal  of  American  Linguis¬ 
tics  .  32,  1 (January,  1966),  pp.  108-121;  William  Francis  Mackey, 

Language  Teaching  Analysis  (London:  Longmans,  Green  &  Co.  Ltd.,  1965), 
p.  414;  Loban,  1961,  op.  cit..  p.  132;  Wallace  Lambert,  "Measurement 
and  Analysis  of  the  Linguistic  Dominance  of  Bilinguals,"  Journal  of 
Abnormal  Social  Psychology.  50(1951),  p.  199;  Wallace  E.  Lambert, 
"Psychological  Approaches  to  Second -Language  Learning  and  Bilingualism," 
Curricular  Change  in  the  Foreign  Languages  (Princeton:  College  Entrance 
Examination  Board,  1963),  p.  28. 

^Mialaret  et  Malandain,  op.  cit..  pp.  13-22;  Dodson,  op.  cit.. 
p.  3;  American  University  Language  Center,  op.  cit. 

^American  Language  Institute,  op.  cit.;  M.  D.  Braine,  "On 
Learning  the  Grammatical  Order  of  Words,"  Psychological  Review.  70 
(1963),  p.  348. 

70 

Fries,  op.  cit..  pp.  291-292;  American  University  Language 
Center,  op.  cit.;  American  Language  Institute,  op.  cit.;  Carroll,  1953, 
op.  cit..  p.  9;  G.  Gougenheim  and  others,  L* elaboration  du  frangais 
fondamental  (ler  degre)  (Paris:  Didier,  1964). 
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The  list  of  factors  that  have  been  proposed  at  one  time  or  another 
is  a  long  one:  (10)  memory- span'71  (11)  accuracy?*^  (12)  fluency?3 
(13)  speech  attitude?^1-  (14)  continuity?3  (15)  comprehensibility^3  and 
(16)  pleasantness.??  Many  of  these  terms  are  as  vague  as  the  concept 
they  offer  to  explain. 

The  Relative  Importance  of  Known  Factors  of  Proficiency 

The  sixteen  factors  of  oral  proficiency  that  have  been  enumerated 
in  the  preceeding  section  are  not  all  identifiable  with  any  degree  of 
objectivity.  In  fact,  in  many  instances  their  legitimacy  has  not  been 
demonstrated.  The  possibility  of  recognition  and  the  legitimacy  of 
factors  of  oral  proficiency  lead  to  another  question  which  is  crucial  in 
the  domain  of  oral  proficiency  evaluation.  The  question  has  to  do  with 
relative  importance  of  the  known  factors  of  proficiency  and  with  the 


?1B.  F.  Skinner,  Verbal  Behavior  (New  York:  Appleton,  Century, 
Crofts,  1957),  pp.  80-85;  Car'roll,  1941,  op.  cit..  p.  298;  Robert  Lado, 
”Memory-Span  as  a  Factor  in  Second -Language  Learning,”  International 
Conference:  Modern  Foreign  Language  Teaching.  Papers  and  Reports  of 

Groups  and  Committees.  Preprints,  Part  I  (Berlin:  Paedagogische 
Arbeitsstelle  und  Sekretariat,  Paedagogisches  Zentrum,  1964). 

? ^Freeman  Twaddell,  Foreign  Language  Instruction  at  the  Second 
Level.  Teacher's  Manual.  Le  francais:  parler  et  lire  (New  York:  Holt, 
Rinehart  and  Winston,  Inc.,  1963),  pp.  6-7. 

?3J.  L.  Gewirtz,  ”Studies  in  Word  Fluency,”  Pedagogical  Seminary 
and  Journal  of  Genetic  Psychology.  72 (June,  1948),  p.  175;  Twaddell, 
op.  cit..  pp.  6-7;  Loban,  1961  op.  cit..  pp.  131-132. 

7 ^Carroll,  1941,  op.  cit..  p.  295. 

?5Ibid. ,  pp.  296-297;  Loban,  1961.  op.  cit. .  p.  136. 

?^Carton,  op.  cit..  p.  2. 

77 Ibid. ,  p.  2. 
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relative  importance  of  their  component  parts» 

Some  evaluators  assume  that  all  factors  are  of  equal  importance. 
Andrade  and  his  associates  give  equal  weighting  to  three  factors: 

(1)  pronunciation  (2)  grammar  and  syntax  (3)  fluency.78  Lado  believes  in 
establishing  a  comprehensive  list  of  contrastive  problems  and  in  attaching 
equal  importance  to  testing  each  one„^  Henri on  warns  against  the  dangers 
of  selecting  vocabulary  on  the  basis  of  frequency. 

George  on  the  other  hand  stresses  that  the  frequency  of  occur¬ 
rence  of  an  element  is  an  index  of  its  usefulness  in  ccmm jnicat ion. 

The  research  that  resulted  in  the  publication  of  "Le  fransais  fondamental" 

! 

is  based  also  upon  the  belief  in  the  value  of  frequency  counts  to  deter¬ 
mine  the  importance  of  language  elements. A  good  example  of  the  dis¬ 
parity  in  the  frequency  of  occurrence  of  language  elements  is  given  by 
Bloch.  He  reports  that  the  Japanese  phonemes  / p/  and  /z/  did  not  occur 
in  a  sample  text  of  2000  running  phonemes,  while  the  phoneme  /a/  occurred 
296  times. 88  The  study  is  based  on  the  assumption  that  frequency  of 


^Manuel  Andrade,  John  L.  Hayman,  and  James  T.  Johnson,  Measurement 
of  Speaking  Skills  in  Elementary  Level  Spanish  Instruction  (Denver- 
Stanford  Project  on  the  Context  of  Instructional  Television) (Stanford: 
Institute  for  Communication  Research,  July,  1963),  p.  2. 

7 ^Robert  Lado,  Language  Testing:  The  Construction  and  Use  of 
Foreign  Language  Tests  (London:  Longmans,  1961),  p.  245. 

80Pierre  Henrion,  "Statistique  et  vocabulaire;  un  mariage 
malheureux,"  Les  langues  modernes.  5 (juillet-aout ,  1949),  pp.  238-245. 

81H.  V.  George,  "Testing --Another  Point  of  View,"  English  Language 
Teaching .  16(1962),  pp.  72-77. 

8*G.  Gougenheim  and  others,  op.  cit. 

88Bernard  Bloch,  "Studies  in  Colloquial  Japanese,  IV,  Phonemics," 
Language.  26(1950),  p.  115. 
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occurrence  is  an  index  to  the  importance  of  a  language  element*  For  that 
reason  an  important  part  of  the  investigation  deals  with  frequency* 

The  Effect  of  Stimuli  on  the  Nature  of  Language  Output 

An  equally  important  question  about  oral  production  that  needs  to  be 
considered  is  constancy  within  one  individual*  Carton  found  that  vari~ 
ations  in  stimuli  affected  the  quality  of  pronunciation*^  Ferenczi 
found  that  perception  of  visuals  depended  on  cultural  background* 85 
Gewirtz  found  that  ’’word- fluency”  is  not  the  same  when  some  restrictions 
are  imposed  on  the  language  to  be  produced  as  when  there  are  no 
restrictions® Cattell  in  1887  reported  that  it  took  more  time  to 
see  and  name  a  color  than  to  see  and  name  an  object,  and  that  it  took 
more  time  to  see  and  name  an  object  than  to  see  and  say  a  printed  word* 8? 
Osgood  in  1953  reported  that  Karworki  and  his  associates  had  reached 
similar  conclusions  in  1944*88  Pillsbury  and  Meader  reported  studies  by 
Griffitts  which  would  indicate  90%  of  subjects  being  tested  would  respond 
better  to  visual  stimuli,  6%  to  sound  stimuli,  and  4%  to  kinaesthetic 
stimuli *8^  The  ratio  of  nouns -verbs  to  adjectives -adverbs  was  found  by 

8<^Carton,  op*  cit*„  p»  11* 

85 

Victor  Ferenczi,  La  perception  de  l'espace  project  if*  Etude 
realisee  aupres  des  travailleurs  africains  analphabetes  en  France 

(Montreal:  Didier,  1966)* 

86 

Gewirtz,  op*  cit**,  p®  175® 

87 

J«  Cattell,  ’’Experiments  on  the  Association  of  Ideas,”  Minds, 
12(1887),  p*  68. 

88c,  E.  Osgood,  Method  and  Theory  in  Experimental  Psychology 
(New  York:  Oxford  University  Press,  1953),  p,  711® 

89 

Walter  B®  Pillsbury  and  Clarence  1*  Meader,  The  Psychology  of 
Lang uage  (New  York:  D.  Appleton  and  Co®,  1928),  p®  101® 


.von®upai5  rfilw  alaab  nolifigl^asvnl  ertt  5o  3xaq  :»na:noqm*  na  noaaai 


b9fl3a9-  b.*  -  :’ c> ; .  a  *  I  bus  !>■  >•  u  3:  rJ  ®  .loq-rx  ^  L  '•  boos  0 


■ 

. 

U«s*mM) 


t3 

«  l'J  )i  V  «  '*  f  *5  »•  V  '  i  I  '  • 


34 


Osgood  to  be  higher  in  suicidal  notes  than  in  ordinary  letters.90 

Children  produce  more  '’speech'1  in  response  to  outdoor  and  picture  situ- 
91 

ations.  A  Pictures,  objects*  and  story  stimuli  have  different  effects 

on  oral  composit ion.* * * *  9^  The  situation  can  be  summarized  in  Carroll's  words: 

Try  as  we  may  to  define  style  as  the  manner  of  treating  subject  matter 
the  type  of  subject  matter  will  in  general  impose  constraints  upon 
the  possible  kinds  of  stylistic  treatment 09^ 

From  this  evidence  comes  the  need  to  investigate  to  what  extent  the 

examiner  determines  the  type  and  quantity  of  language  produced  by  the 

stimuli  which  he  uses. 


III.  PURPOSE  OF  THE  STUDY 

This  study  attempts  to  clarify  the  nature  of  oral  proficiency 
particularly  as  it  applies  to  learners  of  French  as  a  second  language. 

It  does  this  by  trying  to  find  out  whether  language  complexity,  rate  of 
production,  and  frequency  of  hesitation  are  factors  of  proficiency.  It 
tries  to  determine  whether  the  speech  of  the  less  proficient  differs  in 
complexity,  output,  and  hesitation  from  the  speech  of  the  more  proficient. 
If  the  speech  of  the  more  and  less  proficient  differ  in  these  three 


90Charles  E.  Osgood,  "Some  Effects  of  Motivation  on  Style  of 

Encoding,"  Style  in  Language.  Thomas  E.  Sebeok,  editor  (Boston:  The 

Technology  Press,  M.I.T.,  1960),  p,  30. 

9* Young ,  op.  cit.„  p.  127. 

9^Royal  Franklin  Netzer,  "Evaluation  of  a  Technique  for  Measuring 
Improvement  in  Oral  Composition,"  (Unpublished  doctoral  thesis.  University 
of  Iowa,  1937),  p.  39. 

93John  B.  Carroll,  "Vectors  of  Prose  Style,"  Style  in  Language. 
Thomas  E.  Sebeok,  editor  (Boston:  The  Technology  Press,  MoI.T.,  1960), 
p.  292. 
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dimensions,  then  evaluators  of  the  development  of  oral  proficiency  can 
measure  language  on  those  three  dimensions  as  part  of  the  basis  for 
assessing  growth. 

Information  about  the  relative  importance  of  certain  morphological 
and  syntactical  classes  is  developed  from  their  relative  frequency  of 
occurrence.  If  there  are  differences  between  the  frequency  of  occur¬ 
rences  in  the  following  four  classes!  (1)  pronouns  (2)  prepositions  and 
conjunctions  (3)  determiners  (4)  word-order  conflicts,  then  these 
differences  should  be  reflected  in  the  weighting  to  be  given  to  these 
four  classes  in  the  construction  of  tests.  This  information  may  be  more 
manageable  for  the  test  designer  than  a  frequency  count  of  individual 
words  within  these  classes. 

If  rate  of  output  is  indeed  found  to  be  a  factor  of  proficiency 
and  it  can  be  demonstrated  only  in  a  monologue  of  some  considerable 
length,  then  examiners  should  know  whether  for  reasons  of  economy  it  is 
possible  to  rate  other  factors  of  proficiency  such  as  pronunciation  from 
the  same  monologues.  This  study  attempts  to  provide  that  practical 
information. 

And,  fourthly,  this  study  provides  the  examiner  some  information 
on  the  effect  of  the  nature  of  the  stimulus  on  the  nature  of  the  language 
produced  thereby  indicating  some  precautions  that  have  to  be  taken  in 


the  construction  of  tests. 
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CHAPTER  II 


I  was  examined  in  Hebrew. 

"What  is  the  Hebrew  for  'the  place  of  a  skull'?" 

I  replied,  "Golgotha." 

"Very  well,"  said  the  examiner,  "you  are  competent 

for  your  degree." 

Earl  of  Eldon,  Oxford,  1776. 

METHOD  OF  INVESTIGATION 

An  attempt  was  made  in  Chapter  I  to  show  that  it  is  important  to 
evaluate  oral  proficiency  completely.  It  was  proposed  that  the  success 
of  oral  proficiency  evaluation  can  be  improved  in  the  five  following  ways: 
(1)  by  defining  oral  proficiency  more  clearly, (2)  by  introducing  more 
objectivity  into  the  rating  of  speech ,(3)  by  verifying  the  authenticity 
of  as  many  factors  of  proficiency  as  possible, (4)  by  establishing  the 
relative  importance  of  the  factors  of  proficiency  and  of  their  components, 
and  (5)  by  determining  the  effect  of  stimuli  on  the  language  produced. 

Chapter  II  describes  the  selection  of  the  subjects,  the  development 
of  the  testing  instrument,  the  collection  of  the  data,  and  the  coding  of 
the  data.  Then  it  provides  a  list  of  the  hypotheses  to  be  tested  and 
concludes  with  limitations  of  the  study. 

Selection  of  the  Subjects 

To  identify  the  factors  of  proficiency  a  comparison  was  made  of  the 
oral  production  of  groups  of  subjects  that  were  assumed  to  differ  in  that 
dimension.  Three  groups  of  ten  subjects  were  selected: 
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18  Native  speakers  of  French  whose  dominant  language  is  still  French  and 
who  have  completed 9  at  least 9  one  300-level  University  of  Alberta 
French  course  or  its  equivalents,  selected  at  random  from  the  language¬ 
teaching  methods  classes  (A  -  1)0 

2.  Native  speakers  of  English  who  have  completed 9  at  least 9  one  300-level 
University  of  Alberta  French  course  or  its  equivalents,  selected  at 
random  from  the  language “teaching  methods  course  (A  »  2)„ 

30  Native  speakers  of  English  who  have  completed  one  200-level  University 
of  Alberta  French  course  or  its  equivalent  but  no  300-level  course , 
selected  at  random  from  language “teaching  methods  classes  (B  -  2)„ 

This  study  is  modelled  after  one  done  by  W„  E«  Lambert,,*  This 
design  made  it  possible  to  haves,  at  leasts,  two  groups  differing  in  pro¬ 
ficiency;  namely s,  A-l  and  B=2„  Depending  on  the  effect  of  university 
trainings,  group  A-2  could  be  more  like  A-l  or  B-2„  The  presence  of  group 
A-2  thus  provided  valuable  information  on  the  relation  of  university 
training  to  the  development  of  oral  proficiency,,  If  the  speech  of  the 
A-2  group  was  more  like  that  of  the  A-l  group  in  some  respects  than  others, 
one  could  hypothesize  differential  rates  of  development „ 

The  subjects  were  all  selected  from  the  French  teaching  methods 
classes  at  the  University  of  Alberta  in  the  academic  year  1966-67,,  The 
questionnaire  for  "Oral  Proficiency  Test  Subjects”  was  administered  to 
classify  the  subjects  as  to  group„2  A  native-speaker  of  French  is  defined 

^Wallace  E0  Lambert 9  An  Exploratory  Study  of  the  Developmental 
Aspects  of  Second-Language  Acauisi^ionCUnpublished  doctoral  dissert¬ 
ation,  University  of  North  Carolina,  1953) „ 
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as  one  whose  first  language  was  French  and  who  still  considers  French  to 
be  the  language  that  he  speaks  with  most  ease.  For  people  living  in  a 
predominantly  English-speaking  society  and  consequently  gaining  rapidly 
and  constantly  in  their  facility  to  use  English  it  is  not  always  easy  to 
say  which  language  they  speak  with  most  ease.  These  subjects  were  aware 
of  a  shifting  language  preference  from  day  to  day  and  from  one  subject 
of  interest  to  another.  All  those  who  were  unsure  about  their  continued 
preference  for  French  were  excluded  from  the  native  sample.  Of  thirty- 
seven  subjects  who  had  learned  to  speak  French  as  their  first  language, 
only  ten  remained  sure  of  the  dominance  of  French.  Of  these  ten,  two 
had  received  their  elementary  and  secondary  education  in  a  predominantly 
French-speaking  area  of  Quebec  and  one  had  been  educated  in  France. 

Another  had  obtained  his  elementary  schooling  in  Quebec. 

Even  though  an  attempt  was  made  to  make  everyone  feel  that  there 
was  nothing  to  be  gained  from  claiming  a  non-existent  French  dominance, 
a  perusal  of  the  language  produced  could  lead  one  to  conclude  that  some 
subjects  were  rather  poor  judges  of  their  competence  in  French.  Inter¬ 
views  conducted  after  the  selection  of  the  subjects  led  the  investigator 
to  believe  that  some  of  those  excluded  were  more  proficient  than  others 
that  were  included  in  the  native  sample. 

All  the  subjects  of  the  non-native  groups  had  learned  English  as 
their  first  language.  Subjects  whose  first  language  was  not  English  were 
excluded  because  some  of  the  problems  in  the  instrument  were  selected  on 
the  basis  of  a  French-English  contrast.  Command  of  a  language  closely 
related  to  French  could  have  favored  the  development  of  French  proficiency 
and  masked  the  differences  between  native  and  non-natives.  The  non-native 
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subjects  were  assigned  to  B-2  or  A-2  on  the  basis  of  their  university 
experience,. 

Since  university  standing  in  French  is  a  criterion  used  in  estab¬ 
lishing  the  groups ,  the  homogeneity  of  the  groups  may  depend  to  a  large 
extent  upon  the  constancy  and  uniformity  of  the  university’s  placement 
and  promotion  practices,, 

Most  of  the  subjects  of  the  non-native  groups  had  studied  French 
in  grades  X,  XI ,  and  XII*  A  few  had  started  in  grades  VIII  or  IX*  No 
information  was  obtained  on  the  amount  of  oral  work  in  the  high  school 
programs o  One  subject  had  done  one  year  of  French  by  correspondence * 

By  and  large  these  subjects  had  had  few  opportunities  to  use  French  out¬ 
side  of  the  classroom* 

On  the  basis  of  the  questionnaire  the  non-native  speakers  were 
divided  into  two  groups ,  advanced  and  beginners*  A  sample  of  ten  was 
drawn  randomly  from  each  group  so  that  the  sample  would  be  representative 
of  the  group* 

The  thirty  subjects  chosen  were  asked  to  appear  individually 
for  tests  and  none  refused* 

No  information  was  obtained  about  age,  relative  academic  success, 
intelligence,  proficiency  in  the  first  language,  or  emotional  factors 
such  as  self  confidence  because  these  factors  were  not  objects  of  study* 
The  samples  were  predominantly  female* 

The  samples  could  not  be,  strictly  speaking,  random  since  they 
were  drawn  from  language  methods  classes*  However,  statistical  analyses 
were  done  as  if  the  samples  were,  in  fact,  random.  Precautions  were  taken 
at  the  time  of  generalizing  the  findings  in  view  of  the  lack  of  randomness* 
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Development  of  the  Testing  Instrument 

The  construction  of  the  instrument  was  guided  by  four  principles: 

1.  The  subjects  should  provide  a  speech  sample  that  is  representative 
of  their  normal  proficiency. 

2.  The  samples  of  speech  should  be  adequate  to  permit  analysis  in  terms 
of  complexity,  output,  hesitation  and  frequency  of  various  elements. 

3.  There  should  be  samples  obtained  under  diverse  conditions  to  permit 
the  observation  of  constancy  in  the  qualities  of  the  subjects*  speech. 

4.  The  conditions  under  which  all  the  subjects  produced  should  be  iden- 

l 

tical  if  possible  so  that  differences  discovered  between  the  subjects 
could  be  attributed  to  the  subjects  rather  than  to  external  factors. 

To  achieve  the  first  objective,  generally  familiar  topics  were 
chosen.  Because  one  cannot  assume  that  a  subject  will  speak  freely  on 
any  familiar  topic,  several  ideas  were  suggested  on  each  topic  by  means 
of  a  monologue  or  a  series  of  illustrations.  The  same  topics  and  ideas 
were  used  with  all  the  subjects.  In  the  trial  runs  and  in  the  actual 
tests,  it  was  found  that  the  speakers  needed  only  a  small  part  of  the 
ideas  offered.  These  topics  and  ideas  served  especially  to  stimulate 
the  imagination.  The  speaker  was  left  completely  free  to  select  from  the 
many  avenues  offered  and  the  variety  of  ideas  proposed.  The  variety  in 
the  methods  of  treating  these  ideas  and  the  extent  to  which  they  were 
ignored  is  a  good  indicator  that  the  subjects  felt  considerable  freedom. 
Two  experienced  language  teachers  who  were  consulted  believed  that  any 
student  at  this  level  should  be  able  to  produce  freely  on  the  subjects 
proposed. 

An  effort  was  made  in  wording  the  directions  of  the  instrument  to 
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avoid  influencing  the  speaker  by  proposing  artificial  standards  of  profi- 
ciency--the  emphasis  was  on  plain  ordinary  language. ^  Even  though  every 
effort  was  made  to  have  all  subjects  feel  comfortable  and  know  that  formal 
or  literary  language  ttas  not  required,  only  partial  success  was  achieved. 
The  subjects’  comments  after  the  test  about  the  difficulty  of  the  task, 
about  the  inadequacy  of  their  language,  or  their  lack  of  ability  to'speak* 
indicated  that  they  were  concerned  about  their  image. 

To  assist  naturalness  of  production  the  following  steps  were 

taken.  The  first  monologue  of  each  subject  was  for  practice  only.  The 

subjects  were  prevented  from  using  pencil  and  paper  in  order  to  discourage 

them  from  using  written-language  style.  They  were  given  one  minute  to 

organize  their  thinking.  Trial  runs  had  revealed  that  one  minute  was 

sufficient  for  most  subjects,  and  with  longer  preparation  ,  impatience 

and  boredom  had  begun  to  appear.  The  subjects  were  guaranteed  anonymity 

a 

of  their  productions.  Except  for  an  English  version  of  the  directions 
which  they  were  asked  to  read  before  the  use  of  the  instrument  ,  none  of 
the  directions  or  stimuli  were  orthographic  and  none  were  in  English. 

Thus  was  avoided  the  risk  of  interference  from  orthography  or  English 
with  the  subject's  oral  and  French  production. 

The  preceding  discussion  indicated  what  steps  were  taken  to  favor 
normal  speech.  The  discussion  now  proceeds  to  the  adequacy  of  the  samples. 

Different  testers  disagree  about  what  constitutes  an  adequate 
sample  of  speech.  Thornburg  reported  taking  thirty  minutes  to  test  a 
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5 

subject.  Calvet  gave  questions  to  which  the  students  spoke  until  they 
ran  out.  Dodson  considered  five  minutes  necessary, ^  Agard  and  Dunkel 
measured  a  two-minute  production,®  Creore  and  Hanzeli  chose  one-minute, ^ 
and  Lado  selected  the  best  thirty  seconds  from  a  production  of  several 
minutes. Lado*s  technique  seems  to  reduce  the  standardization  of 
administration.  It  also  eliminates  considering  the  factor  of  speech 
readiness. 

In  experimentation  with  responses  to  stimuli  it  was  found  that 
several  speakers  needed  a  few  seconds  to  warm  up  to  their  subjects. 

When  the  stimulus  was  entirely  oral  with  the  subject  not  being  permitted 
to  use  notes,  it  was  found  that  many  producers  tended  to  run  dry  after 
about  one  minute.  For  the  reasons  just  given,  it  was  decided  to  call 

i 

for  one-minute  monologues. 

j 

To  permit  the  analysis  of  constancy  of  production,  it  was  decided 
to  elicit  four  monologues  from  each  subject.  Two  of  these  were  in 
response  to  oral  (0)  stimuli  and  two  in  response  to  visual  (V)  stimuli. 


50.  Thornburg,  "Earlhan^s  Proficiency  Examination  in  Oral  English,'* 
English  Journal.  26(June,  1937),  p.  470. 

6M.  J.  Calvet,  S. ' Sauvageot ,  and  A.  Diop,  L'enseignement  du 
francais  en  Afriaue.  IV-B.  Le  francais  parle.  Enquete  au  lycee  de 
Thies  (Dakar!  Centre  de  linguistique  appliquee,  1963),  p.  1. 

7 

C.  J.  Dodson,  Oral  Examinations  (Aberystwyth,  Wales:  Faculty  of 
Education,  University  College  of  Wales,  1963),  p.  2. 

8F.  B.  Agard  and  H.  B.  Dunkel,  An  Investigation  of  Second- 
Language  Teaching  (Boston:  Ginn  and  Co.,  1948),  p.  57. 

^A.  E.  Creore  and  Victor  E.  Hanzeli,  A  Comparative  Evaluation  of 
Two  Modern  Methods  for  Teaching  a  Spoken  Language  (Seattle:  University 
of  Washington  Press,  1960),  p.  12. 

10Robert  Lado,  Language  Testing;  The  Construction  and  Use  of 
Foreign  Language  Tests  (London:  Longmans,  196l),  p.  245. 
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Lado  and  Stabb  considered  pictures  to  be  the  most  valid  stimuli  but  recog¬ 
nized  that  pictures  alone  did  not  elicit  economically  all  the  language 
required.11  The  oral  stimuli  provided  the  necessary  vocabulary  and  even 
the  sentence  structure  for  the  subject  endowed  with  a  good  enough  memory. 
The  subject's  monologue  could  have  been  in  the  nature  of  a  verbal  recall. 
However,  many  subjects  chose  to  comment  on  the  stimulus  or  to  make  up  an 
entirely  different  narration. 

The  visual  stimuli  which  were  left  before  the  eyes  of  the  subject 
during  production  saved  him  the  concern  about  keeping  enough  ideas  in 
mind  to  speak  for  a  whole  minute.  In  this  respect  the  visual  stimuli 
differed  from  the  oral  stimuli.  There  is  another  respect  in  which  visual 
and  oral  stimuli  differed.  When  speaking  from  a  picture,  a  subject  was 
entirely  dependent  upon  his  own  reservoir  of  words  and  structures.  He 
had  no  proximate  linguistic  model.  The  only  linguistic  direction  offered 

came  from  the  question  directed  to  the  subject  about  the  series  of  illus- 

♦ 

t rat ions. 

In  order  to  determine  the  possibility  of  influencing  the  complexity 
of  language  produced,  one  of  the  oral  stimuli  was  given  a  simple  structure 
and  the  other  a  complex  structure.  A  complex-structure  (C)  stimulus  is 
defined  as  one  that  contains  many  adverbial  or  adjectival  modifying  words, 
phrases,  or  clauses.  A  simple-structure  (S)  contains  few  of  these  modi¬ 
fying  structures 

Mialaret  and  Malandain  specify  three  levels  of  sentence  complexity!2 

11Lado,  1961,  op.  cit.  .  p.  243;  Martin  S.  Stabb,  "An  Experiment 
in  Oral  Testing,0  Modern  Language  Journal »  39(May,  1955),  p.  233. 

12Mialaret  and  Malandain,  op.  cit . ,  pp.  14-22. 
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A  -  Short  sentence  (3  to  7  words)  with  one  verb. 

-  Longer  sentences  expressing  only  one  action  even  with  an  enumeration. 

B  -  Simple  sentence  with  compound  predicate. 

-  Simple  sentence  with  simple  predicate  but  several  modifiers. 

C  -  Expression  of  a  relationship  between  ideas. 

The  maximum  value  given  to  a  sentence  in  category  A  is  1;  B,  2;  and  in 
C,  4. 

They  use  this  formula  also  as  a  measurement  of  output  crediting 
A  as  1  idea,  B  as  2,  and  C  as  3. 

Even  though  Loban  states  that  there  is  more  than  subordination 
to  language  complexity,  his  own  index  of  complexity  consists  of  the 
following  values:AJ  principal  clause,  1;  subordinate  clause,  2;  principal 
clause  containing  a  structure  with  an  infinitive,  gerund,  or  participle,  3; 
subordinate  clause  embedded  in  a  subordinate  clause,  3. 

It  is  proposed  in  this  study  to  keep  separate  the  concepts  of  out¬ 
put  and  complexity.  Predication  will  be  considered  as  an  element  of  out¬ 
put.  Modification  and  relationship  will  be  considered  as  elements  of 
complexity. 

An  Index  of  Complexity  is  computed  as  follows: 

IC  =  (M  +  2F  +  3S)  100 
W 

M  represents  single  word  adjective  or  adverbial  modifiers  with  the 
following  exceptions:  interjections,  articles,  demonstratives,  possessives, 
conjunctions,  relatives,  cardinal  and  ordinal  numbers,  ne--pas,  or 


•^Loban,  op.  cit..  p.  18 
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adjectives  and  adverbs  used  in  the  complement  slote 

F  represents  adjectival  or  adverbial  phrases ,  absolute  phrases, 
and  noun  phrases  in  apposition  which  do  not  have  a  verb  head,  and  not 
phrases  that  are  in  the  subject  or  object  slot. 

S  represents  any  subordinate  clause  and  phrase  having  a  verbal  as 

a  head. 

W  represents  the  total  number  of  words  spoken  in  one  minute. 

The  following  are  the  two  oral  stimuli  adapted  for  the  instrument. 
The  structures  of  modification  are  underlined  and  coded  in  the  right 
margin.  The  data  thus  obtained  are  used  to  calculate  the  index  of 
complexity  for  each  stimulus. 

1.  Simple  Structure  Oral  Stimulus: 

Six  heures  du  matin.  Pas  un  souffle  d*air.  Un  des  chameaux  FFF 

lance  un  cri.  Une  anti lope  surgit,  se  heurte  la  tete  contre  un, 
^rocher .  A  lfhorizon  il  y  des  signes  df orage.  Le  sable  et  la  FFF 
poussiere  tourbillonnent .  Les  canards  sauvages  poussent  des  cris.  M 
II  faut  chercher  un  abri .  Au  dessus  de  ma  tete  je  vois  les  marques  FF 
de  la  derniere  inondation.  Les  eaux  vont  remonter  a  cette  hauteurj  FM 

.la.  II  n*v  a  pas  un  instant  a  perdre.  Les  chameaux  s *agenouillent .FF 

/ 

Chacun  se  perche.  Le  soleil  disparaft.  Les  eclairs  dechirent 
l*obscurite.  Un  coup  de  tonnerre  retentit  et  d*enormes  gouttes  FM 

commencent  a  tomber.  Nos  vetements  col lent  a  not re  peau.  Une  F 

fente  s'ouvre  dans  la  muraille;  nous  atteignons  une  terrasse.  Les  F 
eaux  remuent  a  nos  pieds.  Les  flots  font  crouler  les  murailles.  F 

Enfin  un  rayon  de  soleil.  L* orage  est  fini.1^  (147  words)  F 

^Camille  Bauer,  Margaret  D.  Barton,  Patricia  0*Connor,  Lire , 
parler .  ecrire « Teachers  Manual  (New  York:  Holts  Rinehart  and  Winston, 

1964),  p.  140. 
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2*  Complex  Structure  Oral  Stimulus: 

Les  tricheurs  repr4sentent  un  pr obi erne  pour  leurs  camarades  de  F 

classe  qui  se  demandent  parfois  quelle  attitude  ils  doivent  FM 

adopter  vis  a  vis  d*eux.  Faut-il  les  denoncer?  Faut-il  jouer  leur  SFF 
jeu?  Les  ddnoncer  au  professeur.  je  ne  le  pense  pas.  Une  classe  F 
est  une  petite  communaute  ou  l'on  doit  se  sentir  solidaire  les  M 

uns  des  autres.  Rapporter  et  denoncer  demoliraient  1* esprit  SF 

d^quipe  et  de  bonne  camaraderie  oui  doit  regner  dans  ce  groupe  FFHSF 
et  creeraient,  d* autre  part,  une  lourde  et  penible  atmosphere  FMMM 

de  suspicion.  Le  rapporteur  risquerait  de  se  faire  detester  par  F 
la  classe  entiere.  Done  pas  de  rapportage.  Mais  on  peut  par  FM 
quelques  mots  ou  s implement  par  une  mimique  expressive  faire  FMMFM 

savoir  au  tricheur  que  l'on  n*est  pas  dupe  de  son  manege.  Cela  F 
peut  suffire  a  le  decourager.15  (136  words) 

IC  .  (3  X  3)  +  (2  X  15)  ♦  (IX  10)  x  100  =  36 

136 

It  is  interesting  to  note  that  during  the  trial  runs  and  during 
the  testing  none  of  the  subjects  recognized  that  these  stimuli  differed 
in  complexity. 

An  attempt  was  also  made  to  devise  two  visual  stimuli  that  would 
cause  the  production  of  monologues  differing  in  complexity. *6  The  first 
series  of  pictures  has  the  title,  MLa  journee  d*une  mere  de  f ami lie'1  and 

■^Bauer,  Barton,  and  0*Connor,  op.  cit . .  p.  188. 

16 
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consists  of  a  series  of  pictures  depicting  likely  activities  of  a  house- 

i 

wife.  The  question  asked  was,  "How  does  a  housewife  spend  her  day?"  The 
pictures  were  designed  to  favor  an  enumeration  rather  than  a  discussion 
of  the  activities.  The  other  group  of  pictures  depicts  problems  encountered 
while  camping.  The  subjects  were  asked  to  discuss  problems  related  to 
camping.  It  was  anticipated  that  such  a  discussion  would  abound  in 
structures  of  modification. 

The  instrument  was  recorded  on  tape  so  that  the  directions  and 
timing  would  be  uniform  for  each  subject. ^  A  plan  was  set  up  to  rotate 
the  order  of  presentation  of  stimuli.18  Within  the  limits  of  mathematical 
possibility,  an  attempt  was  made  to  have  each  stimulus  presented  an  equal 
number  of  times  in  the  first,  second,  third,  and  fourth  position  of  order. 
The  same  rotation  plan  was  used  for  each  of  the  three  groups. 

Procedure  for  Obtaining  Data 

The  instrument  was  administered  individually  in  the  language 
laboratory  of  the  Faculty  of  Education,  University  of  Alberta  by  the 
investigator.  The  subject  picked  a  number  from  one  to  ten  to  select  the 
order  in  which  the  stimuli  would  be  presented  to  him.  The  master  tape 
was  played  from  the  console  and  the  subject  first  did  the  practice  mono¬ 
logue  with  microphone  and  headphones  on  and  then  recorded  the  four  mono¬ 
logues  called  for  in  the  instrument.  If  the  subject  complained  that  he 
did  not  understand  an  oral  stimulus,  it  was  played  again  once.  Subjects 

17The  recording  of  the  instrument  (Appendix  B)  is  on  file  at  the 
University  of  Alberta  Education  Library. 
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who  still  complained  that  they  did  not  understand  or  that  they  did  not 
know  what  to  say  were  prompted  to  say  anything  they  could  think  of  even 
if  it  had  little  relation  to  the  topic. 

Six  of  the  subjects  in  the  A-2  group  were  not  sure  of  the  word 
"tricheur"  and  at  least  three  in  B-2  had  the  same  problem.  This  word  had 
not  been  a  problem  for  anyone  during  the  trial  runs.  Many  in  the  non¬ 
native  groups  found  comprehension  of  one  or  both  oral  stimuli  difficult. 
One  confessed  to  having  taken  "orage  dans  le  desert"  for  "oranges  in  the 
dessert" •  The  non-native  preferred  the  visual  stimuli. 

In  the  native  group  one  subject  found  the  pictures  distracting. 

Two  subjects  who  had  read  a  description  of  a  storm  by  St.  Exupery  recently 
found  that  the  similarity  between  the  two  descriptions  interfered  with 
their  production. 

Subjects  who  produced  almost  nothing  in  the  time  alloted  for  one 
monologue  were  encouraged  by  the  examiner  before  being  given  the  stimulus 
for  the  next  monologue.  Some  produced  even  fewer  than  ten  words  in  one 
monologue.  Subjects  were  asked  not  to  discuss  the  measuring  instrument 
with  their  friends  until  all  the  measuring  had  been  completed,  and  no 
information  was  given  out  about  the  specific  purposes  of  the  instrument 
in  case  they  did  talk  about  it 

Coding  of  the  Data 

All  of  the  monologues  were  transcribed  by  the  investigator.^ 
English  words  were  transcribed  but  placed  within  parentheses  and  not 

1 9 

Appendix  F.  This  appendix  includes  all  the  transcriptions  and 
their  coding.  A  recording  of  all  the  monologues  produced  by  the  subjects 
is  on  file  in  the  library  of  the  Faculty  of  Education,  University  of 
Alberta. 
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counted.  French  words  used  incorrectly,  such  as  "dans  le  texte"  for  "in 
the  book'* ,  were  counted.  Words  spoken  before  or  after  the  starting  and 
stopping  signals  were  omitted.  Incomplete  words  were  not  transcribed  but 
were  recorded  under  the  appropriate  hesitation  category.  When  an  inappro¬ 
priate  word  was  used  it  was  transcribed  in  the  conventional  alphabet 
rather  than  in  phonetic  symbols.  In  a  phrase  such  as,  "Les  enfants  ne 
sait  pas11 «  salt  could  just  as  well  have  been  transcribed  as  sais.  "Les 
Arabes  bavard"  for  bavardent  would  have  been  equally  well  represented 
phonetically  by  "Les  Arabes  bavares".  The  following  are  other  examples 
of  an  arbitrary  choice  between  homonyms  made  by  the  transcriber :" pour  les 
montre "tout  la  maison".  In  a  phrase  like  "des  petit  (s)  insectes" 
where  an  improper  liaison  was  made  (in  this  case  with  the  "t"  rather  than 
with  the  "s")  a  letter  was  dropped  to  match  the  transcription  to  the 
production. 

From  the  tape,  an  actual  count  of  vocoids  was  made.  This  was  a 
count  of  the  vowels,  not  the  semi -vowels,  that  were  vocally  realized. 

The  following  nine  types  of  hesitation  phenomena  have  been  iden¬ 
tified  by  Blankenship  and  Kay, 20  and  Maclay  and  Osgood:^!  (1)  non-lexical 
intrusive  sound  (includes  incomplete  words  and  lengthened  final  vowels), 

(2)  sentence  correction  (making  a  substitution  for  more  than  one  word), 

(3)  word  change,  (4)  repetition  of  a  word  or  more,  (5)  stutter  (repet i- 

i 

tion  of  part  of  a  word),  (6)  omission  of  part  of  a  word,  (7)  sentence 


20 Jane  Blankenship  and  Christian  Kay,  "Hesitation  Phenomena  in 
English  Speech?  A  Study  in  Distribution,"  Word.  19  &  20(1963-64), 
pp.  360-372. 

21Howard  Maclay  and  Charles  E.  Osgood,  "Hesitation  Phenomena  in 
Spontaneous  English  Speech,"  Word.  15  &  16(1959-60),  pp.  19-44. 
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incompletion,  (8)  tongue  slip,  and  (9)  unnatural  unfilled  pauses.  The 
type  of  each  hesitation  was  noted  by  number  in  the  transcription.  Where 
a  hesitation  could  belong  to  two  categories,  only  one  was  recorded.  Each 
hesitation  was  counted  only  once.  An  Index  of  Hesitation  ( I  IT )  was  calcu¬ 
lated  using  the  following  formula: 


IH  =  Number  of  Hesitations  X  100 
Number  of  Words 

Several  terms  are  defined  below  since  they  are  given  a  special 
meaning  in  the  study: 

1.  Predicates  --  Finite  or  non-finite  verb  phrase  heads  that  have  not 

been  nominalized,  adjectivized,  or  adverbial ized  but  that  may  be  part 
of  a  phrase  or  clause  that  has  these  functions. 22  in  the  following 
examples  the  countable  predicates  are  underlined. 

1.  ...  desert  semble  bien  arose. 

2.  C*est  devoir  assez  d*eau  pour  permettre  .... 

3.  II  a  eu  des  mirages. 

4.  On  vient  de  decrire. 

5.  Ca  s * avere  un  succes  de  donner  la  responsabilite  d*etablir  .  •  •• 

6.  II  y  a  des  oeufs  a  faire  cuire. 

7.  II s  ont  tendance  a  y  retourner. 

8.  Le  vent  peut  aplanir  .... 

9.  Ils  reussissent  a  survivre. 

10.  II  veut  marcher. 

11.  II  pense  avoir  f ini . 


22Albert  Valdman,  Applied  Linguistics.  French  (Boston:  D.  C.  Heath 
and  Co.,  1961),  p.  22. 
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12.  II  aura  fini  de  penser . 

13.  II  croit  avoir  ete  vole. 

14.  II  finit  par  aimer. 

15.  II  souhaite  pouvoir  unir  .... 

16.  Hatons-nous  de  le  dire . 

17.  II  pourra  prendre  et  dire  .... 

18.  II  faut  aller  se  promener . 

19.  II  a  pu  et  voulu  com prendre. 

20.  C’est  a  voir. 

21.  Elle  aime  a  danser. 

22.  ...  que  vous  devez  rempl ir  pour  le  regarder  et  1 1 affronter , 

23.  II  a  fini  en  chant ant ♦ 

24.  II  a  fini  avant  de  chanter. 

25.  Chanter  demande  de  l’energie. 

26.  Les  officiers  ayant  demande  s*il  y  avait  une  .  .  .,  ils.  .  .  , 

27.  Ca  presente  l’interet  d’etre  .... 

Words  such  as  croit  avoir  ete  in  number  13  are  considered  as  auxi¬ 
liaries  of  the  predicate  as  opposed  to  the  verbs  in  23  and  24  that 
are  interpreted  as  separate  predicates. 

2.  Word-order  conflict  --  dissimilarity  in  word-order  of  English  and 
French  near-equivalents.  Whenever  the  order  of  one  of  several  alter 
native  translations  is  not  in  conflict  with  the  French  near¬ 
equivalent,  no  conflict  is  recorded.  Dichotomous  expressions  such 
as  ne--pas ,  ne-°que ,  and  ne-- jamais  having  one  word  equivalents  in 
English  are  counted  as  conflicts. 


3.  Prepositions  and  conjunctions  include  relative  pronouns,  interrogative 
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adverbs  and  interrogative  pronouns,  au,  aux,  and  des,  du  when  used  as 
contractions  rather  than  as  partitives,,  Au  and  aux  are  counted  as 
containing  a  preposition  (a)  and  a  determiner  (le  or  les),  Du  is 
just  a  determiner  in  "boire  du  lait"  but  it  is  a  preposition  and 
determiner  in  "venir  du  village", 

4.  Noun  Determiners  --  These  are  words  and  not  phrases  or  clauses. 

They  include  articles,  possessives,  demonstratives,  interrogative 
adjectives,  various  adjectives  and  the  article  hidden  by  contractions 
with  prepositions.  Pronouns  are  excluded, 

5.  Pronouns  --  subject,  object,  emphatic,  possessive,  demonstrative, 
and  indefinite  but  not  interrogative  or  relative. 

The  structures  of  modification  were  underlined  and  identified  and 
so  were  the  noun  determiners,  the  prepositions  or  conjunctions,  the  pro¬ 
nouns,  the  predicates  and  the  word-order  errors  of  conflicts.  The  total 
of  words  in  each  monologue  was  obtained  and  was  used  in  the  appropriate 
formula  to  obtain  an  index  of  complexity  and  an  index  of  hesitation  for 
each  monologue.  The  VS  monologues  were  scanned  for  examples  of  twenty 
preselected  pronunciation  problems. 

The  problems  of  pronunciation  selected  are  not  all  phonemic.  They 

have  been  selected  from  contrastive  studies  of  French  and  English  by 

23 

Delattre,  Leon,  Politzer  and  Valdman,  Among  them  can  be  found  problems 


23 

Pierre  Delattre,  Les  difficultes  Phonetiques  du  francais 
(Middlebury:  Ecole  franjaise,  1948);  Monique  Leon,  Exercices 
svstemat ioues  de  prononciat ion  francaise.  I  (Paris?  Hachette  et  Larousse, 
1964);  Monique  Leon,  Exercices  svstematiques  de  prononciation  francaise. 
II  (Paris:  Hachette  et  Larousse,  1964);  Pierre  et  Monique  Leon, 
Introduction  a  la  phonetiaue  corrective  (Paris:  Hachette  et  Larousse 
1964);,  Robert  L.  Politzer,  Teaching  French:  An  Introduction  to  Applied 
Linguistics  (New  York:  Ginn  and  Co,,  1960);  Albert  Valdman,  Appl ied 
Linguistics,  French  (Boston?  D.  C.  Heath  and  Co,,  1961), 
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of  stress,  rhythm,  intonation,  linking,  syllabification  as  well  as  sound- 
segment  production.  A  deliberate  attempt  was  made  to  select  a  wide  variety 
of  problems  that  are  recognized  as  interfering  with  communication.  The 
list  can  be  found  in  the  appendix.2^1- 

The  Hypotheses 

The  following  list  indicates  to  what  subject  each  hypothesis  is 
related. 

HoGC  --  structure  complexity 
HoGV  --  rate  of  output  of  vocoids 
HoGP  --  rate  of  output  of  predicates 
HoGH  -**  frequency  of  hesitation 

HoCC ,  HoCV ,  HoCP,  HoCH  --  stimuli  effect  on  complexity,  output  of  vocoid, 
output  of  predicates,  hesitation 
HoFE  --  frequency  of  errors  by  A-2  and  B-2 

HoFO  --  frequency  of  linguistic  occurrences  in  four  grammatical  classes 
HoP20  --  demonstration  of  20  pronunciation  problems 

HoPC  --  relative  importance  of  pronunciation  elements  in  communication 
HoPE  --  range  of  pronunciation  elements  demonstrated  by  groups  differing 
in  proficiency 

HoGC  -  There  is  no  difference  in  the  structural  complexity  of  speech 

produced  by  the  three  groups  and  judged  on  the  basis  of  all  four 
components  of  this  variable. 

HoCC  -  There  is  no  difference  between  the  structural  complexity  of  speech 
in  the  four  components  considering  all  of  the  three  groups  as  one. 

24 
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HoGV  -  There  is  no  difference  between  the  vocoid  output  of  the  three 
groups  judged  on  the  basis  of  all  four  components  of  this 
variable. 

HoCV  -  There  is  no  difference  between  the  vocoid  output  in  the  four 
components  considering  all  of  the  three  groups  as  one. 

HoGP  -  There  is  no  difference  between  the  predicate  output  of  the  three 
groups  judged  on  the  basis  of  all  four  components  of  this 
variable. 

HoCP  -  There  is  no  difference  between  the  predicate  output  in  the  four 
components  considering  all  of  the  three  groups  as  one. 

HoGH  -  There  is  no  difference  between  the  frequency  of  hesitation  of  the 
three  groups  judged  on  the  basis  of  all  four  components  of  this 
variable. 

HoCH  -  There  is  no  difference  between  the  frequency  of  hesitation  in  the 
four  components  considering  all  the  three  groups  as  one. 

HoFE  -  There  is  no  difference  between  advanced  and  beginning  non-native 
speakers  in  the  frequency  of  errors  in  the  word-order,  and  in 
the  use  of  prepositions  and  conjunctions,  noun  determiners,  and 
pronouns  in  a  monologue. 

HoFO  -  There  is  no  difference  in  the  monologues  of  native  speakers 
between  the  frequency  of  occurrence  of  word-order  conflicts, 
prepositions  and  conjunctions,  noun  determiners,  and  pronouns. 

HoP20  -  A  one-minute  monologue  is  not  adequate  to  demonstrate  proficiency 
in  handling  selected  pronunciation  elements. 

HoPC  -  The  mastery  of  selected  pronunciation  problems  is  not  equally 
important  for  communication. 
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Limitations  of  the  Study 

1*  ^e  following  factors  of  proficiency  are  not  considered  in  this  study! 
(a)  sentence  length,  (b)  speed  of  reaction,  (c)  grammatical  correct¬ 
ness,  (d)  control  of  syntax,  (e)  vocabulary,  (f)  memory-span, 

(g)  accuracy,  (h)  fluency,  (i)  speech  attitude,  (j)  continuity, 

(k)  comprehensibility,  and  (1)  pleasantness.  No  claims  are  made 
about  the  exhaustiveness  of  this  list  or  about  the  legitimacy  of  its 
components. 

2.  Innate  intelligence,  creativity,  and  linguistic  aptitude  are  control¬ 
led  only  to  the  extent  that  the  sample  consists  of  subjects  who  have 
been  successful  in  at  least  one  university  French  course.  It  is 
assumed  that  the  influence  of  the  non-linguistic  factors  just  named 
can  be  randomized  out. 

'i 

3.  The  subjects  first  language  is  avoided  completely  during  the  mono¬ 
logue  production  sessions.  According  to  Sapon,  Brooks,  Cattell,  and 
Lado  there  is  a  danger  of  "contaminating”  proficiency  by  giving 
stimuli  in  another  language. ^  Consequently  from  this  study  it  is 


25 

Stanley  M.  Sapon,  "Report  of  the  Committee  on  Tests,"  Reports 
of  the  Working  Committees.  Northeast  Conference  on  the  Teaching  of 

Foreign  Languages  (Oxford,  Ohio!  Miami  University,  1956),  p.  35; 

Nelson  Brooks,  "Definition  of  Language  Competencies  Through  Testing," 
Reports  of  the  Working  Committees.  Northeast  Conference  on  the  Teaching 

of  Foreign  Languages  (Oxford,  Ohio!  Miami  University,  1959),  pp.  54-55; 
Cattell,  op.  cit*.  p.  68;  Robert  Lado,  "English  Language  Testing! 
Problems  of  Validity  and  Administration,"  English  Language  Teaching. 
14(1960),  pp.  153-160. 
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not  possible  to  make  any  claims  about  the  nature  of  proficiency  in  a 
bilingual  testing  situation. 

4.  In  this  study,  the  findings  are  not  applied  to  the  construction  of  a 
test,  but  the  development  of  tests  of  oral  proficiency  has  been  the 
main  reason  for  the  study. 

5.  Because  the  experimental  groups  are  made  up  of  university  graduates 
and  undergraduates,  the  findings  may  have  only  limited  application 
in  the  testing  of  children  or  of  beginning  students  of  language. 

6.  Since  conversation  is  not  made  up  only  of  one-minute  monologues,  it 
cannot  be  claimed  that  this  study  provides  a  description  of  speech 
produced  in  conversation. 
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CHAPTER  III 


'*Je  vis  de  bonne  soupe  et  non  de  beau  langage." 

Moliere,  Les  femmes  savantes. 

DATA,  THEIR  ANALYSES,  AND  RESULTS 

The  data  for  the  first  four  major  groups  of  hypotheses  dealing 
with  structural  complexity,  rate  of  vocoid  output,  rate  of  predicate 
output,  and  frequency  of  hesitation  are  presented  in  tables  like 
Table  II.  Column  one  shows  that  there  are  three  equal  groups  each  con¬ 
sisting  of  ten  subjects:  A-l ,  A-2 ,  and  B-2.  These  three  groups  represent 
one  factor  in  the  analyses. 

Four  observations  were  made  on  each  subject.  These  observations 
consisted  of  four  monologues  spoken  in  response  to  four  stimuli  different 
in  nature:  (1)  oral  simple  structure  (2)  oral  complex  structure 
(3)  visual  complex  structure  (4)  visual  simple  structure.  These  four 
observations  are  listed  in  a  row  to  the  right  of  the  subject.  Each  of 
the  last  four  columns,  therefore,  represents  the  results  of  the  same 
observation  on  the  thirty  subjects.  This  dimension  represents  the  second 
factor  of  the  analyses.  The  variable  in  this  dimension  is  the  stimuli 
and  the  analyses  permit  a  measurement  of  the  differences  in  the  nature 
of  speech  produced  as  responses  to  the  various  stimuli. 

Two-factor  Analysis  of  Variance  with  Repeated  Measures  on  One  Factor 

A  two-factor  analysis  of  variance  with  repeated  measures  on  one 
factor  is  applicable  to  the  hypotheses  on  the  first  four  major  areas  of 


investigation: 
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TABLE  II 

INDEX  OF  COMPLEXITY  CLASSIFIED  BY  SUBJECT  AND  MONOLOGUE 


Subjects 

OS 

OC 

VC 

VS 

1 

57 

26 

37 

40 

2 

30 

43 

15 

21 

3 

24 

21 

39 

36 

4 

17 

32 

28 

39 

A-l  5 

16 

17 

28 

23 

6 

41 

36 

38 

33 

7 

39 

29 

45 

43 

8 

29 

29 

32 

30 

9 

50 

35 

38 

55 

10 

28 

28 

32 

46 

11 

26 

17 

40 

38 

12 

30 

32 

34 

31 

13 

25 

36 

37 

35 

14 

17 

27 

23 

25 

A-2 

15 

21 

37 

27 

35 

16 

16 

16 

34 

24 

17 

39 

27 

38 

43 

18 

28 

27 

29 

35 

19 

25 

23 

28 

21 

20 

24 

23 

27 

25 

21 

22 

28 

27 

23 

22 

18 

28 

18 

26 

23 

34 

6 

16 

27 

24 

16 

17 

21 

24 

B-2 

25 

20 

19 

20 

39 

26 

18 

25 

37 

27 

27 

24 

54 

23 

29 

28 

38 

32 

29 

29 

29 

46 

27 

44 

17 

30 

15 

15 

35 

9 
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1.  structure  complexity 

2.  rate  of  vocoid  output 

3.  rate  of  predicate  output 

4.  frequency  of  hesitation 

Two  hypotheses  are  advanced  in  relation  to  each  of  the  areas. 

The  first  hypothesis  in  each  area  is  intended  to  investigate  whether  the 
factor  is  an  aspect  of  proficiency.  The  second  one  is  intended  to  inves¬ 
tigate  whether  the  factor  of  proficiency  varies  with  the  nature,  of  the 
stimuli . 

The  language  of  the  groups  drawn  from  populations  believed  to 
differ  in  proficiency  is  compared  as  to  complexity,  output,  and  hesitation 
to  determine  whether  these  are  factors  of  proficiency.  In  this  comparison 
the  four  observations  on  each  subject  are  not  considered  separately. 

Then  the  language  obtained  as  a  result  of  the  four  treatments  is 
compared  to  determine  whether  variations  in  stimuli  have  an  effect  on 
complexity,  output,  and  hesitation.  In  this  comparison  the  thirty 
subjects  are  considered  as  one  group. 

i 

A  two-factor  analysis  with  repeated  measures  on  one  factor  is  con¬ 
sidered  to  be  appropriate  for  the  following  reasons:1 

1.  It  provides  a  statistical  control  over  individual  differences  between 
treatments.  Treatment  effects  for  a  given  subject  are  measured  rela¬ 
tive  to  the  average  response  made  by  that  subject  on  all  treatments. 
The  separation  of  individual  error  from  treatment  effects  and  exper¬ 
imental  error  increases  the  sensitivity  of  the  experiment. 


1B.  J.  Winer,  Statistical  Principles  in  Experimental  Design  (New 
York:  McGraw-Hill,  1962),  pp.  105-124;  298-306. 
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2.  Using  different  subjects  under  each  of  the  treatment  combinations  has 
the  advantage  of  providing  statistically  independent  estimates  of 
treatment  effects  from  all  cells  in  the  experiment* 

3.  By  having  each  subject  serve  as  his  own  control ,  it  is  possible  to 
work  with  a  smaller  sample  size  and  still  obtain  meaningful  results. 

4.  It  is  possible  to  spread  sequence  effects  on  all  the  treatment 
effects  by  counterbalancing  the  order  of  administering  the  treatments. 

The  selection  of  this  design  is  based  on  the  following  assumptions: 

1.  The  subjects  in  each  group  are  a  random  sample  taken  from  a  large 
population.  It  was  pointed  out  earlier  that  drawing  subjects  from 
language -teaching  methods  classes  does  not,  strictly  speaking,  conform 
to  this  assumption. 

2.  The  variance  is  the  same  for  all  treatments  since  the  same  subjects 
are  observed  under  all  the  treatments. 

3.  The  population  covariances  are  equal. 

4.  If  the  population  covariances  are  not  equal,  the  usual  F  tests  gives 

positively  biased  results.  '*The  critical  value  as  obtained  from  an 

F  table  tends  to  be  too  low  relative  to  a  critical  value  appropriate 

o 

for  an  arbitrary  variance -covariance  matrix.**  In  other  words  if  the 
homogeneity  assumptions  are  not  met,  the  differences  will  appear  to 
be  more  significant  than  they  are. 

When  the  assumptions  of  homogeneity  are  not  met,  an  approximate 
test  can  be  made  using  the  usual  F  statistic  and  by  dividing  the 
degrees  of  freedom  for  the  numerator  and  denominator  of  F  ratios  by 

2Ibid. .  p.  123. 
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(fc-1)  where  k  is  the  number  of  treatments.  This  is  the  maximum 
correction  needed  for  any  amount  of  heterogeneity  and  as  such  gives 
negatively  biased  results.  Negatively  biased  results  are  results 
that  make  differences  appear  less  significant  than  they  are. 

It  was  found  in  this  study  that  dividing  the  degrees  of  freedom 
by  (k-1),  or  3,  did  not  change  the  results.  Therefore,  even  though 
variance-covariance  matrices  are  assumed  to  be  homogeneous  in  this 
study,  the  results  would  remain  unchanged  if  the  assumption  did  not 
hold.  For  this  reason,  the  matrices  were  not  examined  for  homogeneity. 

Structural  Complexity 

The  first  of  the  two  hypotheses  serves  to  investigate  the  differ¬ 
ence  in  structural  complexity  of  language  produced  by  speakers  differing 
in  proficiency*  The  second  hypothesis  serves  to  consider  the  relationship 
between  stimuli  and  complexity. 

HoGC  -  There  is  no  difference  in  the  structural  complexity  of  speech 

produced  by  the  three  groups  and  judged  on  the  basis  of  all  four 
components  of  this  variable. 

HoCC  -  There  is  no  difference  between  the  structural  complexity  of  speech 
in  the  four  components  considering  all  the  three  groups  as  one. 

The  indices  of  complexity  computed  from  the  four  monologues  pro¬ 
duced  by  each  of  the  thirty  subjects  are  presented  in  Table  II,  page  58. 
Subject  13  was  replaced  after  drawing  the  samples  because  he  was 
discovered  to  be  only  an  auditor  in  the  methods  class  and,  therefore,  not 
to  belong  properly  to  the  sample. 
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The  results  of  the  analysis  of  variance  appear  in  Table  IIIo  The 
complexity  of  speech  produced  by  the  three  groups  differed  at  the  #05 
level o  Therefore  there  is  a  positive  relationship  between  the  structural 

complexity  of  the  language  spoken  and  the  oral  proficiency  of  the  speaker# 

A  measurement  of  this  aspect  of  a  spoken  production  is  an  index  of  the 
proficiency  of  the  speaker#  As  Table  III  indicates  null  hypothesis  GC 
is  not  supported#  Structural  complexity  is  a  factor  of  proficiency# 

The  difference  between  the  means  of  the  three  groups  was  submitted  to  the 
Newman-Keuls  Test  to  determine  whether  all  the  means  are  significantly 
different  from  each  other#  Only  the  means  of  A~1  and  B-2  differed  from 
each  other  at  the  #05  levels  as  shown  in  Table  IV# 

The  results  presented  in  Table  III  also  show  that  the  structural 
complexity  of  the  four  components  does  not  differ  significantly#  The 

complexity  of  the  language  produced  in  response  to  OS ,  0C»  VC  and  VS 

stimuli  does  not  change.  The  structural  complexity  of  the  language 
produced  is  comething  which  is  very  personal  and  cannot  be  influenced 
externally.  A  complex  stimulus  does  not  tend  to  lead  to  a  complex 
response#  Oral  and  visual  stimuli  are  equally  ineffective  in  determining 
the  structural  complexity  of  responses#  The  null  hypothesis  CC  is 
supported  by  these  results# 

The  range  in  the  Indices  of  Complexity  of  the  outputs  (6  to  57)  is 
much  greater  than  the  range  between  the  Indices  of  Complexity  of  the 
stimuli  (23  to  36)#  This  is  further  evidence  of  the  personal  nature  of 
structural  complexity# 

Since  the  largest  Indices  of  Complexity  seem  to  be  generated  from 
outputs  of  less  than  ten  words  (for  examples  IC  =  57;  W  =  7)9  evaluators 
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TABLE  III 

ANALYSIS  OF  VARIANCE  IN  INDEX  OF  COMPLEXITY 


Source  of  Variation 

DF 

MS 

F 

Bet.  groups  (A) 

2 

769.059 

*4.410 

Sub.  within  groups 

27 

174.386 

Bet.  monologues  (B) 

3 

93.432 

0.929 

Interaction  (A  X  B) 

6 

76.613 

0.762 

B  X  sub.  within  groups 

81 

100.584 

TABLE  IV 

NEWMAN -KEULS  TEST  OF  DIFFERENCE  BETWEEN  MEANS  OF  INDICES 
OF  STRUCTURAL  COMPLEXITY  OF  GROUPS 


Groups 

B“2 

A-2 

A-l 

Means 

25.5 

28.6 

34.2 

Differences  between  means 

B-2 

A-2 

— 

3.1 

*8.7 

5.6 

S-  =  /  174.386  0  2.08 

A  J  10  X  4 

r  - 

2 

3 

p  .95(r ,27) 

2.92 

3.53 

p  .99(r,27) 

3.96 

4.54 

S-  p  .  95(r,27) 

6.07 

7.34 

S-  p  .99(r,27) 

8.24 

9.44 

*  significant  at  the  .05  level. 
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of  oral  proficiency  using  the  Index  of  Complexity  as  a  metric  would  be 
well-advised  not  to  apply  it  to  outputs  of  less  than  25  words.  In 
addition  in  view  of  the  inconstancy  found  in  the  IC*s  generated  by  some 
subjects  (a  range  of  20  is  not  uncommon)  there  is  a  danger  inherent  in 
basing  judgment  on  a  single  output. 

The  interaction  effect  between  groups  and  monologues  is  not  a 
subject  of  this  study.  However,  the  experimental  design  made  its  exam¬ 
ination  possible.  The  interaction  is  not  found  to  be  significant.  It 
can,  therefore,  be  inferred  that  the  four  stimuli  had  the  same  effect  on 
all  three  groups. 

Rate  of  Vocoid  Output 

There  are  two  hypotheses  related  to  the  rate  of  vocoid  output. 

The  first  one  serves  to  investigate  the  difference  between  the  rates  of 
vocoid  output  of  groups  differing  in  proficiency.  The  second  deals  with 
the  difference  between  the  rates  of  vocoid  output  with  different  stimuli. 

HoGV  -  There  is  no  difference  between  the  vocoid  output  of  the  three 

groups  judged  on  the  basis  of  all  four  components  of  this  variable. 
HoCV  -  There  is  no  difference  between  the  vocoid  output  in  the  four  com¬ 
ponents  considering  all  the  three  groups  as  one. 

The  number  of  vocoids  spoken  by  each  subject  in  each  of  four  mono¬ 
logues  is  presented  in  Table  V.  The  results  of  the  analysis  of  variance 
are  given  in  Table  VI. 

As  Table  VI  shows,  there  is  a  great  difference  between  the  rates 
at  which  speakers  differing  in  proficiency  emit  vocoids.  The  difference 
between  the  rate  of  vocoid  output  of  the  three  proficiency  groups  is 
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TABLE  V 

RATE  OF  VOCOID  OUTPUT  CLASSIFIED  BY  SUBJECTS  AND  MONOLOGUES 


Subjects 

OS 

OC 

VC 

VS 

1 

9 

126 

138 

161 

2 

81 

115 

115 

91 

3 

81 

141 

111 

145 

4 

140 

166 

183 

115 

A=I  5 

95 

129 

103 

125 

6 

163 

159 

145 

168 

7 

183 

225 

238 

203 

8 

160 

139 

196 

171 

9 

126 

142 

162 

171 

10 

115 

168 

169 

187 

11 

82 

68 

114 

110 

12 

73 

83 

83 

95 

13 

64 

87 

120 

93 

14 

69 

19 

69 

87 

A-2 

15 

43 

33 

64 

65 

16 

50 

67 

100 

95 

17 

99 

114 

94 

102 

18 

64 

49 

65 

81 

19 

8 

63 

70 

99 

20 

72 

86 

78 

84 

21 

68 

83 

98 

97 

22 

71 

92 

99 

110 

23 

71 

61 

99 

100 

24 

68 

101 

117 

105 

B-2 

25 

55 

103 

88 

127 

26 

59 

41 

58 

75 

27 

38 

16 

77 

85 

28 

37 

59 

90 

70 

29 

65 

84 

55 

82 

30 

88 

86 

82 

101 

66 


TABLE  VI 


ANALYSIS 

OF  VARIANCE  OF 

VOCOID  OUTPUT 

Source  of  Variation 

DF 

MS 

F 

Bet.  groups  (A) 

2 

58,539 

•kit 

25.981 

Sub.  within  groups 

27 

2253 

Bet.  monologues  (B) 

3 

6,788 

** 

17.493 

Interaction  (A  X  B) 

6 

514 

1.326 

B  X  sub.  within  groups 

81 

388 

TABLE  VII 

NEWMAN-KEULS  TEST  OF  DIFFERENCE  BETWEEN  MEANS 

OF  VOCOID  OUTPUT  OF  GROUPS 

OF  RATES 

Groups 

A*=2 

B“2  A “ 1 

Means 

76.5 

79.0  144.0 

A-2 

2.5  **67.5 

Differences  between  means 

B*»2 

**65.0 

S;  =  p”- “I  -  7.51 

r  = 

2  3 

p  .95(r,27) 

2.92  3.53 

p  .99(r,27) 

* 

3.96  4.54 

SA  . 95 (r ,27) 

21.92  26.51 

SA  .99(r j.27) 

29.74  34.10 

**  significant  at  the  .01  level. 
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significant  at  the  .01  level#  The  null  hypothesis  GV  is  not  supported. 

It  seems  then  that  the  rate  of  vocoid  output  is  an  aspect  of  proficiency. 

Some  additional  inferences  about  rates  of  vocoid  output  can  be 
drawn  from  Table  VII.  The  mean  outputs  for  groups  A»2,  B°2,  and  A°1  are 
76.5,  79.0,  and  144.0.  The  outputs  of  A~2  and  B-2  do  not  differ  from 
each  other.  There  is, however,  a  great  difference  between  the  outputs  of 
the  native  and  the  non- native  groups.  It  is  significant  at  the  .01  level. 
It  seems  that  the  non-natives  are  a  long  way  from  achieving  native  rate 
of  output  and,  if  the  slight  difference  between  the  rates  of  output  of 
A-2  and  B-2  is  a  reliable  indicator,  they  are  making  very  slow  progress 
in  closing  that  gap. 

The  rates  of  vocoid  output  in  response  to  various  stimuli  differs 
at  the  .01  level.  The  rate  of  vocoid  output  is  affected  by  the  stimuli. 
Stimuli  differ  in  fertility.  The  null  hypothesis  CV  is  not  supported. 

Table  VI  also  shows  that  there  is  no  interaction  effect  between 
groups  and  treatments.  It  seems  that  various  stimuli  affect  the  rate  of 
vocoid  output  of  the  three  groups  in  the  same  way. 

Table  VIII  gives  the  four  mean  rates  of  vocoid  output  determined 
from  the  monologues  produced  in  response  to  four  different  stimuli.  The 
means  for  OS,  OC ,  VC,  and  VS  are  79.9,  96.8,  109.3,  and  113.3  respectively. 
It  is  apparent  from  the  order  that  visual  stimuli  are  more  fertile  than 
oral  stimuli.  The  differences  between  VC  and  VS  on  one  hand  and  OS  on 
the  other  are  significant  at  the  .01  level.  The  means  of  VC  and  VS  differ 
from  the  mean  of  OC  at  the  .05  level. 

Either  the  investigator's  attempt  to  build  structure  complexity 
into  the  visual  stimuli  was  not  successful  or  complexity  of  the  stimuli 
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has  no  effect  on  the  output.  The  means  of  VC  and  VS  do  not  differ. 

The  means  of  the  responses  to  the  oral  stimuli  differ  at  the. 05 
level  but  the  complex  stimuli  are  more  fertile  than  the  simple  stimuli. 
This, with  the  observation  about  the  lack  of  effect  of  complexity  in 
visual  stimul i; suggests  that  complexity  of  stimuli  really  has  no  bearing 
on  output. 


TABLE  VIII 

NEWMAN-KEULS  TEST  OF  DIFFERENCE  BETWEEN  MEANS  OF  RATES 
OF  VOCOID  OUTPUT  BY  MONOLOGUES 


Monologues 

OS 

OC 

VC 

VS 

Means 

79.9 

96.8 

109.3 

113.3 

OS 

**16.9 

**29.4 

**33.4 

Differences  between  means 

oc 

*12.5 

*16.5 

VC 

4.0 

s  _  388.057  „  2,62 

B  10  X  3 

r  = 

2 

3 

4 

q  .95(r,81) 

2.83 

3.40 

3.74 

q  .99(r,81) 

3.76 

4.28 

4.60 

Sg  q  .95(r,8l) 

10.24 

12.31 

13.54 

S5  q  ,99(r ,81) 

13.61 

15.49 

16.65 
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Rate  of  Predicate  Output 

One  could  logically  expect  vocoid  and  predicate  output  to  be 
measurements  of  the  same  dimension  of  speech#  However,  there  is  another 
possibility#  If  one  assumes  that  predicates  represent  the  substantive 
part  of  oral  communication  and  that  vocoids  are  sounds  empty  of  content, 
then  the  rate  of  predicate  output  may  be  a  better  index  of  proficiency# 
There  are  two  hypotheses  related  to  rate  of  predicate  output. 

The  first  one  serves  to  investigate  whether  there  is  a  difference  in  the 
rate  of  predicate  output  of  groups  differing  in  oral  proficiency.  The 
second  one  deals  with  the  difference  between  the  rates  of  predicate  out¬ 
put  after  stimuli  differing  in  nature# 

HoGP  -  There  is  no  difference  between  the  predicate  output  of  the  three 

groups  judged  on  the  basis  of  all  four  components  of  this  variable. 
HoCP  -  There  is  no  difference  between  the  predicate  output  in  the  four 
components  considering  all  of  the  three  groups  as  one. 

The  rates  of  predicate  output  in  the  four  monologues  spoken  by 
the  thirty  subjects  are  shown  in  Table  IX#  The  results  of  the  analysis 
of  variance  given  in  Table  X,  show  that  the  rates  of  output  of  the  groups 
differ  at  the  .01  level.  The  null  hypothesis  GP  is  not  supported  by  this 
evidence# 

The  results  of  the  test  for  the  differences  between  the  group 
means  are  presented  in  Table  XI.  The  means  of  the  predicate  outputs  for 
A-2 ,  B-2 ,  and  A-l  are  9.1,  9.3,  and  16#1  respectively.  The  rates  of 
predicate  output  of  the  two  non-native  groups  do  not  differ,  but  the 
native  group  differs  from  the  non-native  groups  at  the  .01  level. 
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TABLE  IX 


RATE  OF  PREDICATE 

OUTPUT  CLASS IFIEE 

i  BY 

SUBJECT  AND 

MONOLOGUE 

Subjects 

OS 

OC 

VC 

VS 

1 

1 

19 

15 

18 

2 

9 

13 

14 

14 

3 

11 

15 

9 

15 

4 

17 

20 

17 

18 

A-l  5 

13 

17 

12 

14 

6 

16 

19 

16 

16 

7 

14 

20 

21 

18 

8 

21 

23 

25 

24 

9 

15 

14 

16 

16 

10 

13 

16 

22 

21 

11 

11 

12 

10 

12 

12 

9 

11 

11 

10 

13 

9 

8 

15 

12 

14 

7 

3 

11 

11 

A-2  15 

5 

4 

9 

5 

16 

7 

8 

10 

14 

17 

12 

15 

8 

12 

18 

8 

4 

7 

16 

19 

1 

6 

10 

12 

20 

9 

5 

8 

9 

21 

10 

11 

11 

11 

22 

10 

11 

12 

12 

23 

8 

11 

12 

9 

24 

6 

10 

13 

9 

B-2 

25 

8 

12 

12 

12 

26 

9 

5 

7 

8 

27 

2 

2 

10 

11 

28 

5 

6 

10 

9 

29 

5 

7 

7 

12 

30 

10 

10 

12 

17 

' 
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TABLE  X 

ANALYSIS  OF  VARIANCE  OF  PREDICATE  OUTPUT 


Source  of  Variation 

DF 

MS 

F 

Bet.  groups  (A) 

2 

639.808 

**24.759 

Sub.  within  groups 

7 

25.842 

Bet.  monologues  (B) 

3 

84.231 

**12.072 

Interaction  (A  X  B) 

6 

12.064 

1.729 

B  X  sub.  within  groups 

81 

6.977 

NEWMAN -KEULS 
OF 

TABLE  XI 

TEST  OF  DIFFERENCES  BETWEEN 
PREDICATE  OUTPUT  BY  GROUPS 

MEANS  OF 

RATES 

Groups 

A-2 

B-2 

A-l 

Means 

9.1 

9.3 

16.1 

Differences 

A-2  _ _ 

between  means 

B-2 

0.2 

**7.0 

**6.8 

/ 25.842 
YlO  X  4 


.254 


r  =  2 


3 


P  . 95(r ,27) 
p  .99(r ,27) 

S^  p  .95(r,27) 

SA  p  .99(r ,27) 


2.92  3.53 
6.07  7.34 
0.74  0.89 


1.01 


1.15 


« 
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The  rates  of  output  in  response  to  each  stimulus  also  differ  at 
at  the  *01  level*  It  can  be  concluded  that  the  rates  of  predicate  out¬ 
put  differ  with  different  stimuli*  The  evidence  does  not  support  the 
null  hypothesis  CP. 

An  examination  of  the  results  reported  in  Table  XII  reveals  that 
the  monologue  means  are  9.39  11*2*  12. 49  and  13*6  for  OS  9  0C9  VC9  and  VS 
respectively.  The  ranking  of  the  stimuli  as  to  fertility  is  the  same  as 
that  obtained  from  the  measurement  of  vocoid  output,  the  visual  stimuli 
are  more  fertile  than  the  oral  stimuli.  There  is  no  discernible  pattern 
in  the  effect  of  the  complexity  of  stimuli. 


TABLE  XII 

NEWMAN-KEULS  TEST  OF  DIFFERENCES  BETWEEN  MEAN  RATES 
OF  PREDICATE  OUTPUT  BY  MONOLOGUES 


Monologues 

OS 

OC 

VC 

VS 

Means 

9.3 

11*2 

12.4 

13.6 

OS 

**1 . 9 

**3.1 

**4.3 

Differences  between  means 

OC 

1.2 

**2.4 

VC 

1.2 

o  Z6.977 

SB  V 10  X  3  "  -5° 

r  = 

2 

3 

4 

q  .95(r981) 

2*83 

3.40 

3.74 

q  .99(rs>8l) 

3.76 

4*28 

4.60 

Sg  q  .95(r,8l) 

•o 

1*41 

1.70 

1.87 

Sfi,  q  .99(r,81) 

1.88 

2.14 

2*30 
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The  means  of  0C9  VCS  and  VS  differ  at  the  .05  level  from  OS.  The 
mean  of  VS  differs  significantly  from  QC„  But  while  VC  differs  from  OC 
at  the  .05  level  in  comparing  vocoid  outputs „  the  two  means  do  not  differ 
in  comparing  predicate  output.  Therefore  a  measurement  of  the  rate  of 
vocoid  output  is  inferred  to  be  the  more  sensitive  to  the  effect  of  the 
stimuli . 

In  predicate  output  as  in  vocoid  output  and  complexity  there  is  no 
interaction  between  groups  and  treatments.  It  can  be  inferred  that  all 
the  stimuli  are  related  in  the  same  way  to  the  three  groups. 


The  next  two  hypotheses  deal  8  first  of  all9  with  the  difference 
between  the  frequency  of  hesitation  of  groups  differing  in  proficiency 
and9  secondly;,  with  the  difference  between  the  frequency  of  hesitation  in 
response  to  different  stimuli. 


HoGH  »  There  is  no  difference  between  the  frequency  of  hesitation  of  the 
three  groups  judged  on  the  basis  of  all  four  components  of  this 
variable. 

HoCH  ~  There  is  no  difference  between  the  frequency  of  hesitation  in  the 
four  components  considering  all  the  three  groups  as  one. 

The  Index  of  Hesitation  for  each  subject  in  each  of  four  monologues 
is  reported  in  Table  XIII.  The  results  of  the  analysis  of  variance  for 
the  Index  of  Hesitation  are  presented  in  Table  XIV.  From  these  results 
one  can  conclude  that  proficient  speakers  hesitate  less  than  speakers  who 
are  not  as  proficient.  The  groups  differ  at  the. 01  level  as  to  hesi= 
tation.  The  means  of  Indices  of  Hesitation  as  reported  in  Table  XV  are 


rf-J  rf tI  a  3o  3?:  :1  (J  JUsii  aaBgrlloqyrl  ov:J  3xva  &riT 


V  n  a  :b  i.c  roi%  *tc  no  3a*f^9  >.  to  \  i?  £.rf*  rr  >9  r4ad 


9ao  ac  aquo'' *5  Taarrl:1  i I&  y  i-ys  <•<  i  . :  _  i  ruoD: 


. 


•  V1X  *5  .  -.1  j  .  J<j>4n '--~9-rq  inn  no l  rl;.  o  '  o  I  .-»il3 


74 


TABLE  XIII 


INDEX  OF  HESITATION  SELECTED  BY  SUBJECT  AND  MONOLOGUE 

Subjects 

OS 

OC 

VC 

VS 

I 

57 

8 

15 

4 

2 

25 

16 

10 

10 

3 

11 

12 

23 

7 

4 

2 

9 

3 

5 

A-l 

5 

11 

15 

13 

13 

6 

7 

3 

4 

2 

7 

14 

10 

8 

7 

8 

10 

13 

8 

2 

9 

4 

8 

9 

5 

10 

17 

15 

7 

6 

11 

5 

12 

8 

9 

12 

9 

12 

9 

5 

13 

29 

14 

7 

14 

14 

27 

22 

20 

18 

A-2 

15 

26 

33 

25 

25 

16 

29 

32 

23 

22 

17 

15 

10 

21 

16 

18 

11 

21 

31 

11 

19 

50 

25 

21 

10 

20 

32 

23 

28 

18 

21 

36 

29 

23 

24 

22 

19 

17 

17 

16 

23 

29 

24 

21 

19 

24 

26 

14 

17 

14 

B-2 

25 

27 

18 

21 

13 

26 

25 

29 

23 

22 

27 

24 

31 

19 

15 

28 

39 

27 

19 

22 

29 

19 

21 

30 

9 

30 

19 

18 

18 

11 
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TABLE  XIV 

ANALYSIS  OF  VARIANCE  IN  INDEX  OF  HESITATION 


Source  of  Variation 

DF 

MS 

F 

Bet,  groups  (A) 

2 

1333.300 

**10.553 

Sub.  within  groups 

27 

126.348 

Bet.  monologues  (B) 

3 

444.989 

**9.515 

Interaction  (A  X  B) 

6 

2.922 

0.062 

B  X  sub.  within  groups 

81 

46.765 

TABLE  XV 

NEWMAN -KEULS  TEST  OF 
INDICES  OF 

DIFFERENCE 

HESITATION 

BETWEEN  MEANS 
BY  GROUPS 

OF 

Groups 

A-l 

A-2 

B-2 

Means 

10.7 

19.4 

21.6 

A-l 

**8.7 

**10.9 

Difference  between  means 

A-2 

2.2 

S *  -  / 126.348-  0  ]. ,78 

A  V  10  X  4 

r  « 

2 

3 

p  .95(r,27) 

2.92 

3.53 

p  .99(r,27) 

3.96 

4.54 

S-  p  .95 (r,27) 

5.19 

6.28 

S-  p  . 99(r ,27 ) 

7.05 

8.08 
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10.7,  19.4,  and  21.6  for  A-l ,  A-2,  and  B-2  respectively.  The  speech  of 

i 

the  non-native  groups  differs  at  the  .01  level  from  the  speech  of  the 
natives  as  to  Index  of  Hesitation.  The  null  hypothesis  GH  is  not  sup¬ 
ported.  However,  the  speech  of  the  two  non-native  groups  is  the  same 
in  hesitation. 

There  is  a  difference  in  the  frequency  of  hesitation  after  differ¬ 
ent  stimuli.  The  Index  of  Hesitation  for  the  monologues  differs  at  the 
•01  level  also.  These  conclusions  lead  to  the  rejection  of  the  null 
hypothesis  CH. 

The  means  of  the  Indices  of  Hesitation  reported  in  Table  XVI  are 
12.4,  16.7,  18.0,  and  21.8  for  the  VS,  VC,  OC,  and  OS,  monologues  res¬ 
pectively. 


TABLE  XVI 

NEWMAN-KEULS  TEST  OF  DIFFERENCE  BETWEEN  MEAN  INDICES 
OF  HESITATION  BY  MONOLOGUES 


Monologues 

VS 

VC 

OC 

OS 

Means 

12.4 

16.7 

18.0 

21.8 

VS  _ 

*4.3 

**5.6 

**9.4 

Differences  between  means 

VC 

1.3 

*5.1 

OC 

3.8 

SR  -  /46.765  .  1.25 

r  = 

2 

3 

4 

q  .95 (r ,81) 

2.83 

3.40 

3.74 

q  .99(r ,81) 

3.76 

4.28 

4.60 

Sg  q  .95(r,81) 

3.54 

4.25 

4.66 

Sg  q  .99(r,81) 

4.70 

5.35 

5.75 
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The  visual  simple  stimulus  monologues  have  fewer  hesitations  than  each  of 
the  monologues  that  followed  the  other  stimuli.  The  VS  and  VC  monologues 
differ  at  the  .05  level.  The  VS  monologues  differ  at  the  .01  level  from 
the  monologues  obtained  in  response  to  oral  stimuli. 

There  does  not  seem  to  be  any  clear  demarcation  between  the  fre¬ 
quency  of  hesitation  found  in  monologues  that  follow  oral  and  visual 
stimuli  because  OC  and  VC  monologues  do  not  differ  from  each  other  as  to 
frequency  of  hesitation*  Neither  does  there  seem  to  be  a  clear  demarca¬ 
tion  between  the  frequency  of  hesitation  in  monologues  after  complex  and 
simple  stimuli  because  OC  and  OS  monologues  do  not  differ  from  each  other. 

Nevertheless  changes  in  oral  proficiency  or  in  the  nature  of 
stimuli  are  accompanied  by  changes  in  the  frequency  of  hesitation.  It  is 
sometimes  suggested  that  hesitation  is  related  to  physical  or  emotional 
factors.  While  there  is  no  evidence  here  to  contradict  this  suggestion, 
differences  in  the  degree  of  proficiency  and  in  the  nature  of  stimuli 
are  accompanied  by  differences  in  the  frequency  of  hesitation. 

Relationship  of  Output  and  Hesitation 

In  the  previous  sections  output  ofvocoids,  output  of  predicates 
and  Index  of  Hesitation  as  aspects  of  proficiency  have  been  considered 
independently.  It  is  appropriate  to  present  some  generalizations  related 
to  all  three.  These  generalizations  are  given  in  Table  XVII. 

Ordering  the  stimuli  according  to  the  mean  rate  of  vocoid  output, 
rate  of  predicate  output,  and  Index  of  Hesitation  reveals  that  the  order 
of  the  means  is  the  same  for  the  two  measurements  of  output.  However, 
the  order  of  means  of  Index  of  Hesitation  is  exactly  opposite  to  the  means 
of  output.  Output  and  hesitation  have  a  high  negative  relationship  to 
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each  other#  A  count  of  vocoids  is  a  better  discriminator  of  rates  of 
output  than  a  count  of  predicates  because  the  vocoid  count  shows  a  signi- 
ficant  difference  between  VC  and  OC  while  the  predicate  count  does  not. 
Visual  stimuli  produce  more  output  and  fewer  hesitations.  Differences  in 
the  Index  of  Hesitation  accompany  differences  in  the  nature  of  the  visual 
stimuli  but  not  differences  in  the  nature  of  the  oral  stimuli.  The 
opposite  is  true  for  the  rates  of  output.  It  seems  also  from  these  data 
that  with  fertile  stimuli  the  Index  of  Hesitation  is  the  more  discrimi¬ 
nating  metric  and  that  with  arid  stimuli  rate  of  output  is  more 
discriminating . 


TABLE  XVII 

ORDER  OF 

STIMULI  ACCORDING  TO  CERTAIN  SELECTED 

FACTORS  OF  PROFICIENCY 

Means 

High  to  Low 

Vocoid  output 

VS  «  VC  £  OC  *4  OS 

Predicate  output 

VS  »  VC  «  OC  jfc  ±  OS 

Index  of  hesitation 

OS  »  OC  =  VC  f  VS 

Legend  for  Table  XVII 
*=  non-significant  difference 

or  =,  =  significant  difference  at  the  .05  level 
£  £  significant  difference  at  the  .01  level 
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Frequency  of  Errors  bv  the  Advanced  and  Beginning  Non-Natives 

The  next  hypothesis  is  related  to  the  frequency  of  errors  made  by 
advanced  and  beginning  non-native  learners  of  French.  The  purpose  of 
this  investigation  is  to  find  out  whether  A-2  and  B-2  can  be  differen¬ 
tiated  by  a  count  of  errors  in  word-order,  prepositions  and  conjunctions, 
determiners,  and  pronouns.  The  number  of  errors  made  by  each  subject  in 
each  of  the  four  categories  is  shown  in  Table  XVIII. 

HoFE  -  There  is  no  difference  between  advanced  and  beginning  non-native 
speakers  in  the  frequency  of  errors  in  word-order  and  in  the  use 
of  prepositions  and  conjunctions,  noun  determiners,  and  pronouns 
in  a  monologue. 

I 

It  can  be  seen  from  Table  XVIII  that  several  subjects  made  mistakes 
in  only  one  or  two  of  the  four  areas.  Only  one  mistake  in  word-order 
is  recorded.  These  observations  may  lead  one  to  conclude  that  a  count 
of  errors  is  not  a  good  metric  for  comparing  the  oral  proficiency  of 
speakers  at  this  stage  of  development. 

The  analysis  of  variance  results  presented  in  Table  XIX  show 
that  groups  A-2  and  B-2  do  not  differ  in  the  frequency  of  errors  they 
make  in  any  of  the  four  areas.  The  null  hypothesis  is  confirmed.  These 
findings,  coupled  with  those  obtained  on  complexity,  output  of  vocoids 
and  predicates,  and,  lastly,  hesitation  suggest  that  if  the  aspects 
measured  are  indeed  factors  of  oral  proficiency,  the  four  hour  a  week 
exposure  to  university  language  instruction  that  the  subjects  in  A-2  had 
for  a  year  in  addition  to  the  instruction  that  the  subjects  in  B-2  had, 
has  not  improved  their  oral  proficiency  in  the  dimensions  just  named. 
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TABLE  XVIII 

FREQUENCY  OF  ERRORS  IN  WORD-ORDER,  PREPOSITION-CONJUNCTION, 
DETERMINERS,  AND  PRONOUNS  IN  MONOLOGUES  SPOKEN 
BY  A-2  AND  B-2  AFTER  A  VS  STIMULUS 


WOE 

PCE 

Det  E 

Pro  E 

II 

0 

2 

2 

0 

12 

0 

2 

2 

1 

13 

1 

2 

3 

4 

14 

0 

0 

0 

0 

A-2 

15 

0 

0 

0 

1 

16 

0 

0 

1 

0 

17 

0 

1 

0 

0 

18 

0 

0 

0 

1 

19 

0 

6 

0 

0 

20 

0 

1 

0 

0 

21 

0 

0 

0 

0 

22 

0 

0 

1 

2 

23 

0 

2 

0 

0 

24 

0 

0 

4 

3 

B-2 

25 

0 

0 

2 

1 

26 

0 

1 

0 

0 

27 

0 

1 

1 

1 

28 

0 

1 

3 

0 

29 

0 

3 

2 

2 

30 

0 

1 

2 

1 

* 


£ 

i 

. 
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TABLE  XIX 

ANALYSIS  OF  VARIANCE  IN  FREQUENCY  OF  ERRORS  IN  WORD-ORDER, 
PREPOS IT IONS -CONJUNCT IONS ,  DETERMINERS  ,  AND  PRONOUNS 
IN  MONOLOGUES  SPOKEN  BY  A-2  AND  B-2  AFTER 

A  VS  STIMULUS 


Source  of  Variation 

DF 

MS 

F 

Bet.  groups  (A) 

1 

0.200 

0.104 

Sub.  within  groups 

18 

1.922 

Relative  Frequencies  of  Grammatical  Classes 

This  hypothesis  raises  the  question  of  whether  four  grammatical 
classes,  arbitrarily  defined  and  selected,  are  of  equal  importance  in 
communication.  Would  a  lack  of  mastery  of  any  of  these  areas  result  in 
an  equal  lack  of  proficiency?  It  should  be  recalled  that  word-order 
conflicts  are  defined  from  bilingual  contrast. 

HoFO  -  There  is  no  difference  in  the  monologues  of  native  speakers 
between  the  frequency  of  occurrence  of  word-order  conflicts, 
prepositions  and  conjunctions,  noun  determiners ,  and  pronouns . 

The  frequencies  of  occurrence  of  word-order  conflict,  pronouns, 
determiners,  and  prepositions  and  conjunctions  in  A-l  monologues  in 
response  to  VS  stimuli  are  given  in  Table  XX.  These  four  classes  differ 
greatly  in  importance  if  frequency  of  occurrence  in  native  speech  is  a 
valid  indication.  The  frequencies  of  word-order  conflict,  pronouns, 
determiners,  and  prepositions  and  conjunctions  are  related  to  each  other 
in  a  ratio  of  1  J  4  :  7  :  8  respectively.  The  null  hypothesis  FO  is  not 


confirmed. 
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TABLE  XX 


FREQUENCY  OF  WORD 
AND  PREPOSITIONS 

“ORDER  CONFLICTS  s 
AND  CONJUNCTIONS 

PRONOUNS , 
IN  A-l  VS 

DETERMINERS , 
MONOLOGUES 

Subjects 

woe 

Pron 

Det 

P  &  C 

1 

1 

13 

25 

27 

2 

3 

14 

12 

11 

3 

2 

10 

23 

28 

4 

1 

12 

33 

19 

5 

2 

12 

20 

16 

6 

1 

20 

25 

24 

7 

9 

11 

18 

46 

8 

4 

19 

21 

27 

9 

8 

12 

20 

36 

10 

1 

15 

31 

28 

Totals 

32 

138 

228 

262 

Ratio 


1 


4 


7 


8 


« 


i 


83 


If  frequency  of  occurrence  of  a  linguistic  element  or  category  is 
an  index  of  its  importance  to  communications,  then  realistic  evaluation  of 
oral  proficiency  should  not  give  equal  weight  to  these  four  areas. 

Demonstration  of  Pronunciation  Skill  in  "Free11  Production 

A  common  device  used  in  pronunciation  tests  is  to  direct  the  sub¬ 
ject  to  produce  certain  utterances  chosen  because  they  contain  selected 
problem  sounds,  the  production  of  which  the  examiner  wants  to  evaluate. 

Because  there  are  testing  situations  where  free  speech  is  also  desirable, 

[ 

it  would  be  convenient  if  pronunciation  could  be  rated  from  the  free 
rather  than  the  controlled  production.  This  investigation  includes  an 
attempt  to  determine  whether  one  can  find  the  ability  to  use  twenty  pre¬ 
selected  pronunciation  elements  demonstrated  in  a  one-minute  monologue. 

The  elements  are  determined  from  English-French  contrastive  analysis. 

They  therefore  exist  independently  of  the  proficiency  of  the  speaker. 

The  next  hypothesis  serves  to  investigate  the  adequacy  of  one- 
minute  monologues  to  demonstrate  mastery  of  pronunciation. 

HoP20  -  A  one-minute  monologue  is  not  adequate  to  demonstrate  proficiency 

i 

in  using  selected  pronunciation  elements. 

The  X*s  in  Table  XXI  show  which  problems  have  not  been  demon¬ 
strated  by  a  given  subject.  Demonstration  may  have  been  successful  or 
unsuccessful.  The  totals  in  the  SDP  row  represent  the  number  of  subjects 
out  of  thirty  who  have  demonstrated  each  problem. 

Table  XXI  shows  that  seven  out  of  twenty  pronunciation  problems 
are  demonstrated  in  every  monologue.  The  seven  that  have  a  high  frequency 
at  least  in  this  context  are  the  following: 
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TABLE  XXI 

DEMONSTRATION  OF  PRONUNCIATION  PROBLEMS  BY  SUBJECTS  IN  VS  MONOLOGUES 
*  2  3  7  8  9  11  12  14  16  17  18  19  20  TPD  MEAN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 


X  16 
X  16 
X  15 
X  16 

X  14  A-l 

X  15  15.0 

X  13 
X  16 
X  14 
X  15 


11 

X 

X 

X 

X 

16 

12 

X 

X 

X 

X 

X 

X 

X 

13 

13 

X 

X 

X 

X 

16 

14 

X 

X 

X 

X 

16 

15 

X 

X 

X 

X 

X 

X 

14 

A-2 

16 

X 

X 

X 

X 

X 

X 

14 

14.4 

17 

X 

X 

X 

X 

X 

X 

X 

13 

18 

X 

X 

X 

X 

X 

X 

14 

19 

X 

X 

X 

X 

X 

15 

20 

X 

X 

X 

X 

X 

X 

X 

13 

21 

X 

X 

X 

X 

X 

15 

22 

X 

X 

X 

X 

16 

23 

X 

X 

X 

X 

X 

15 

24 

X 

X 

X 

X 

X 

X 

X 

X 

12 

25 

X 

X 

X 

X 

X 

15 

B-2 

26 

X 

X 

X 

X 

X 

X 

14 

13.9 

27 

X 

X 

X 

X 

X 

X 

X 

X 

12 

28 

X 

X 

X 

X 

X 

X 

X 

13 

29 

X 

X 

X 

X 

X 

X 

X 

X 

12 

30 

X 

X 

X 

X 

X 

15 

SDP 

28 

0 

26 

23 

28 

12 

0 

26 

0 

25 

24 

28 

3 

Legend  for  Table  XXII  , 

*  -  problems  1,  4,  5,  6,  10,  13,  15  were  demonstrated  by  all  30  subjects 

X  -  pronunciation  problem  not  demonstrated  in  the  monologue 
S  -  subjects 

TPD  -  total  of  problems  demonstrated  by  the  subject 

SDP  -  number  of  subjects  who  have  demonstrated  the  problem 

Refer  to  Appendix  G  for  the  numbered  list  of  pronunciation  problems 
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1.  diphthongization  of  / i /  or  /e/  in  a  final  unchecked  posit ion--dit . 

2*  giving  /  /  quality  to  a  vowel  in  the  position  of  an  unstressed  vowel 
in  English -“-support. 

3.  intercalating  of  nasalized  consonants- -vend . 

4.  substituting  /E/  for  / a/ --cent . 

5.  producing  a  non-acceptable  variety  of  /r/. 

6.  aspirating  an  initial  /p,  t,  k /  . 

7.  sounding  a  normally  silent  final  consonant. 

The  pronunciation  problems  that  do  not  occur  once  are  these  three: 

1.  producing  /ae  /  before  / i/ --feuille. 

2.  producing  /z  ♦  j/  sequences-°les  veux. 

3.  realizing  /ae /  before  h  aspire—autre  hache. 

In  addition  the  intervocalic  /z/  for  /s/  is  demonstrated  only 
twelve  times  and  the  forbidden  1  iaison  after  a  singular  noun,  only  three 
times.  The  other  eight  problems  are  demonstrated  at  least  twenty-three 
times.  The  numbers  appearing  in  parentheses  in  the  list  which  follows 
represent  the  number  of  demonstrations. 

1.  diphthongization  of  / u/  or  /o/  in  a  final  unchecked  syllable  (28) --boue. 

2.  /w/  for  / y/  (26) -- iuin. 

3.  /oj/  for  /wa/  (23)--moi . 

4.  /I/  for  /j/  (28)— fille. 

5.  /h/  for  h  aspire  or  muet  (26) --homme. 

6.  closed  syllables  (25)--Il  est  ouvert. 

7.  carry-over  of  English  stress  (24) --appartement . 

8.  high  points  of  succeeding  phrases  in  the  ascending  part  of  the  state¬ 
ment  each  higher  than  the  previous  one  (28). 
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The  null  hypothesis  P20  is  confirmedo  The  relative  importance  of 
a  pronunciation  element  is  not  only  a  phonemic*  non° phonemic  distinction. 
On  the  basis  of  frequency  not  all  phonemes  are  equally  important.  The 
difficulty  of  producing  a  given  element  depends  also  on  its  distribution. 
Subjects  that  can  produce  /ob/  and  / z/  may  not  do  so  in  liaison.  The 
tendency  of  speakers  of  English  to  replace  /s/  by  /z/*  for  example*  is 
not  common  to  all  distributions  of  / s/ .  Specifying  a  pronunciation 
element  as  to  identity  and  distribution  reduces  its  frequency  of  occurrence 
so  much  that  an  evaluator  cannot  normally  expect  to  find  it  in  a  one- 
minute  monologue. 

Equality  in  Importance  of  Pronunciation  Elements 

HoPC  -  The  mastery  of  selected  pronunciation  problems  is  not  equally 

important  for  communication. 

The  null  hypothesis  PC  is  confirmed  also.  It  is  obvious  from 
Table  XXI  that  the  frequency  of  encounter  of  each  pronunciation  problem 
is  far  from  being  equal. 

In  the  early  stages  of  language  learning  if  it  is  sufficient  to 
be  able  to  handle  the  high  frequency  pronunciation  problems,  then  a 
monologue  is  an  adequate  test  of  pronunciation  provided  that  the  subject 
has  progressed  far  enough  in  language  mastery  to  be  able  to  produce  an 
adequate  monologue.  This  type  of  test  is*  however*  not  likely  to  be 
useful  as  a  diagnostic  instrument  since  by  definition  a  diagnostic  test 
is  concerned  with  very  specific  problems  and  a  wide  range  of  them. 

In  the  advanced  stages  of  proficiency  development  there  is  a 
need  to  test  low  frequency  problems.  Testing  of  pronunciation  requires, 
at  least  in  some  areas,  closely  controlled  production. 
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Relative  Frequency  of  Pronunciation  Elements 

This  hypothesis  serves  to  investigate  whether  more  proficient 
speakers  attempt  or  use  a  wider  variety  of  pronunciation  elements  than 
the  less  proficient. 

HoPE  -  There  is  no  difference  between  the  number  of  pronunciation 

elements  used  by  three  proficiency  groups. 

The  greatest  difference  between  means  is  between  A-l  and  B-2.  By 
means  of  a  t-test  for  independent  samples  it  is  found  that  the  difference 
between  the  means  of  A-l  and  B-2  is  not  significant .  **  s^  =  1.71  and 
t_  ss  1,86.  For  significance  at  the  .05  level  with  18  degrees  of  freedom 
a  t_  value  of  2.101  would  have  been  required.  Since  the  t-test  between 
the  most  widely  separated  pair  of  means  does  not  reveal  a  significant 
difference,  none  of  the  means  is  significantly  different  from  another. 

Hypothesis  PE  is  confirmed.  In  other  words  the  theory  that  lan¬ 
guage  learners  avoid  language  that  contains  pronunciation  problems  for 
them  is  not  supported  by  this  investigation.  Some  other  justification 
is  needed  for  the  inclusion  of  questions  in  a  test  requiring  a  subject  to 
demonstrate  his  ability  to  deal  with  a  particular  pronunciation  problem. 

Conclusion 

The  thirteen  hypotheses  originally  listed  in  chapter  II  were 
tested  in  this  chapter.  The  first  eight  were  used  to  consider  the  status 
of  structural  complexity,  rates  of  output  and  frequency  of  hesitation  in 

■^George  Ferguson,  Statistical  Analysis  in  Psychology  and  Education 
(new  York:  McGraw-Hill,  1966),  pp.  167-168. 
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oral  proficiency.  By  comparing  the  speech  of  three  groups  assumed  to 
differ  in  oral  French  proficiency  it  was  found  that  groups  which  differ 
in  oral  proficiency  also  differ  in  their  structural  complexity,  rates  of 
output  and  frequency  of  hesitation. 

The  same  three  aspects  of  proficiency  were  measured  in  response 
to  four  different  stimuli.  It  was  found  that  structural  complexity  does 
not  vary  with  the  stimuli  but  that  rates  of  output  and  frequency  of 
hesitation  do. 

The  other  five  hypotheses  tested  are  more  closely  related  to  the 
evaluation  of  oral  proficiency.  Investigations  related  to  these  revealed 
that  the  non-native  groups  could  not  be  distinguished  by  the  number  of 
mistakes  they  made  in  four  grammatical  classes.  They  also  revealed  that 
on  the  basis  of  frequency  of  occurrence  these  four  classes  are  not 
equally  important. 

The  investigation  also  revealed  that  a  one-minute  monologue  was 
not  adequate  for  rating  pronunciation  of  low  frequency  items  because 
there  was  little  likelihood  of  their  being  demonstrated.  The  study 
revealed  too  that  natives  do  not  demonstrate  a  wider  range  of  pronun¬ 
ciation  elements  than  non-natives.  Finally  it  was  found  that  pronun¬ 
ciation  elements  like  grammatical  elements  are  not  all  equally  impor¬ 
tant  because  they  differ  in  frequency  of  occurrence. 

The  next  chapter  presents  summaries  of  the  research  and  of  the 
findings.  The  findings,  the  experience  gained  in  the  study,  and  the 
information  gained  from  the  survey  of  the  literature  related  to  oral 
proficiency  and  its  evaluation  are  used  as  a  basis  for  some  conclusions 
about  the  nature  of  oral  proficiency  and  about  methods  of  evaluating  it. 
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CHAPTER  IV 


u0  cervelle  indocilel 

Faut-il  qu'avec  les  soins  qu'on  prend  incessamment 
On  ne  te  puisse  apprendre  a  parler  congrumentl” 

Moliere,  Les  femmes  savantes 

I.  SUMMARY  OF  THE  RESEARCH 

This  study  has  compared  the  speech  of  three  groups  of  ten  univer¬ 
sity  students  who  were  assumed  to  differ  in  oral  French  proficiency. 

The  group  assumed  to  be  the  least  proficient  was  composed  of  native 
speakers  of  English  who  had  completed  only  one  university  French  course. 
The  second  most  proficient  group  was  composed  of  native  speakers  of 
English  who  had  completed  at  least  two  university  French  courses.  The 
most  proficient  group  consisted  of  native  speakers  of  French  who  had 
completed  at  least  two  university  French  courses. 

In  order  to  elicit  four  one-minute  samples  the  subjects  were 
exposed  to  four  especially  prepared  stimuli.  Two  of  these  were  one- 
minute  monologues  and  two  were  series  of  black  and  white  pictures.  One 
of  the  oral  stimuli  contained  few  structures  of  modification  and  the 
other  contained  many;  they  differed  in  complexity.  An  attempt  was  made 
to  develop  in  the  two  visual  stimuli  a  difference  that  would  elicit  res¬ 
ponses  differing  in  complexity. 

It  was  hypothesized  that  the  three  groups  would  produce  language 
which  did  not  differ  in  (a)  structural  complexity  (b)  rate  of  vocoid  out¬ 
put,  (c)  rate  of  predicate  output,  and  (d)  frequency  of  hesitation. 
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Complexity  and  hesitation  were  compared  on  the  basis  of  an  index  which 
related  a  count  of  the  occurrences  with  the  output  in  a  given  production. 

It  was  also  hypothesized  that  the  four  different  st imul i  would 
have  no  relation  to  complexity,  output,  and  hesitation. 

A  two-way  analysis  of  variance  with  repeated  measurements  on  one 
factor  was  used.  The  repeated  measurements  were  the  monologues  produced 
in  response  to  the  four  different  stimuli.  The  significance  of  the  dif¬ 
ference  between  the  individual  group  and  monologue  means  was  tested  using 
the  Newman-Keuls  Test. 

With  an  analysis  of  variance,  a  comparison  was  made  of  the  frequ¬ 
ency  of  errors  made  by  the  two  non-native  groups  in  the  following  areas: 

1.  Word-order  conflict. 

2.  Prepositions  and  conjunctions. 

3.  Noun  determiners. 

4 .  Pronouns . 

The  relative  frequency  of  occurrences  in  the  four  areas  just 
named  was  also  compared  in  the  speech  of  natives. 

From  English -French  contrastive  analysis  twenty  pronunciation 
problems  were  selected.  One  monologue  was  analyzed  to  determine  if  the 
three  groups  used  all  of  these  twenty  elements  or  if  one  group  used  more 
of  them  than  the  other  groups  did.  This  investigation  was  aimed  at  deter¬ 
mining  whether  less  proficient  speakers  have  a  greater  tendency  to  avoid 
some  pronunciation  elements  and  whether  a  monologue  could  be  expected  to 
provide  an  examiner  with  examples  of  production  of  the  pronunciation 
elements  that  he  wants  to  evaluate. 

The  relative  frequency  of  these  pronunciation  elements  was  also 
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compared  as  a  guide  to  their  relative  importance * 

II o  SUMMARY  OF  THE  MAIN  FINDINGS 

1.  The  evidence  presented  indicates  that  complexity  is  a  factor  of  oral 
proficiency,,  The  speech  of  native  speakers  of  French  has  a  higher 
Index  of  Complexity  than  the  speech  of  those  learning  French  as  a 
second  language  at  the  beginning  or  advanced  stages * 

2.  The  complexity  of  language  output  is  not  found  to  be  influenced  by 
the  nature  of  the  stimuli:  it  is  invariably  associated  with  the  level 
of  oral  proficiency  attained  by  the  speaker  irrespective  of  the 
stimuli  being  oral  or  visual ,  simple  or  complex* 

3.  The  rate  of  output  of  vocoids  and  predicates  is  found  to  be  a  factor 
of  oral  proficiency*  Native-speakers  of  French  emit  in  a  given 
interval  a  much  greater  volume  of  predicates  and  vocoids  than  non¬ 
natives  unless  the  non-natives  have  had  considerably  more  experience 
in  French  than  the  population  from  which  this  sample  was  drawn* 

4.  The  rate  of  output  of  vocoids  and  predicates  seems  to  depend  to  a 
large  extent  on  the  nature  of  the  stimuli*  Visual  stimuli  appear 
to  be  more  fertile  than  oral  stimuli;  visual  simple  stimuli,  more 
fertile  than  visual  complex  stimuli. 

5.  A  count  of  vocoids  seems  to  be  a  better  discriminator  of  rates  of 
output  than  a  count  of  predicates* 

6.  Hesitation  is  a  negative  factor  in  proficiency*  Non-native  speakers 
of  French  hesitate  much  more  than  native  speakers  of  French.  The 
degree  of  hesitation  is  determined  at  least  in  part  by  a  speaker* s 
proficiency  and  not  just  by  other  factors 9  such  as  psychological 
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characteristics  like  self-confidence. 

7.  The  amount  of  hesitation  is  related  to  the  nature  of  the  stimuli. 

More  hesitation  is  associated  with  oral  stimuli  than  with  visual 
stimuli.  These  findings  are  equally  true  for  native  and  non-native 
speech. 

8.  Hesitation  seems  to  be  affected  more  by  differences  in  the  nature  of 
visual  stimuli  than  by  differences  in  the  nature  of  oral  stimul i .  The 
reverse  is  found  to  be  true  about  output.  It  seems  to  be  affected 
more  by  differences  in  the  nature  of  oral  stimuli  than  by  differences 
in  the  nature  of  visual  stimuli. 

9.  With  fertile  stimuli,  the  Index  of  Hesitation  is  the  more  discrimin¬ 
ating  metric;  with  arid  stimuli  the  rate  of  output  is  the  more  discri¬ 
minating  metric. 

10.  The  differential  effect  of  various  stimuli  is  the  same  on  all  levels 
of  oral  proficiency. 

11.  The  oral  proficiency  of  the  advanced  non-native  learners  of  French 
is  not  found  to  be  superior  to  that  of  the  beginning  non- native 
learners  of  French. 

12.  None  of  the  variables,  namely,  (a)  count  of  errors  in  word-order, 

(b)  usage  of  prepositions  and  conjunctions,  (c)  usage  of  determiners, 
or  (d)  usage  of  pronouns  seems  to  distinguish  the  advanced  and  be¬ 
ginning  non-native  learners  of  French  in  regard  to  oral  proficiency. 

13.  The  frequencies  of  occurrence  of  interlanguage  word-order  conflict, 
pronouns,  determiners,  and  prepositions  and  conjunctions  in  native 
oral  French  are  related  to  each  other  in  a  ratio  of  1  J  4  :  7  :  8 
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15 0  Non-native  speakers  of  French,  advanced  or  beginning  ,  use  as  great  a 
variety  of  pronunciation  elements  as  native  speakers  during  a  one- 
minute  monologue.  These  elements  are  selected  theoretically  by 
bilingual  contrasts,.  They  may  not  be  problems  for  non-native 
speakers  and  surely  are  not  for  native  speakers,, 

IIIo  CONCLUSIONS  ABOUT  THE  NATURE  OF  ORAL  PROFICIENCY 

1.  The  fact  that  the  rate  of  output  of  native  speakers  differs  from 
that  of  non-native  speakers  raises  the  question  of  whether  or  not 
there  is  a  minimum  rate  of  output  acceptable  to  native-speakers. 

Marty  claims  that  it  is  150  syllables  per  minute.^  It  is  not  known 
in  what  precise  meaning  Marty  uses  the  word  '♦syllable'1  or  under  what 
conditions  he  would  make  the  "syllable"  count.  The  presence  of  the 
mute  £  in  French  makes  various  definitions  of  syllable  possible.  Rate 
of  output  would  be  increased;  for  example ,  if  subjects  were  told  to 
speak  as  fast  as  they  can.  But  if  one  can  assume  that  vocoids  and 
syllables  are  roughly  equivalent ,  then  according  to  Table  VI,  twenty- 
two  of  the  forty  monologues  spoken  by  the  native -speaker  sample  were 
produced  at  a  rate  below  the  minimum  acceptable  to  native -speakers. 
The  average  vocoid  output  on  four  monologues  is  less  than  150  per 
minute  for  five  out  of  the  ten  native -speakers.  The  highest  rate  of 
output  by  a  non-native  is  127  vocoids  per  minute. 

The  data  resulting  from  this  study  suggest  that  an  average  of  100 

1 Fernand  Marty,  Programming  a  Basic  Foreign  Language  Courses 
Prospects  for  Self -Instruction  (Roanoke,  Va.s  Audio-visual  Publications, 
1962),  p.  3. 
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vocoids  per  minute  could  serve  as  a  limit  to  distinguish  native  from 
non-native  speakers  if  the  output  is  obtained  and  counted  according 
to  the  method  used  in  this  study  and  if  it  can  be  assumed  that  the 
speech  of  the  "native  speakers"  in  this  study  is  really  of  native 
quality.  The  highest  average  output  from  a  non-native  speaker  was 
102  vocoids  per  minute. 

Marty  also  suggests  that  a  minimum  acceptable  rate  of  audio¬ 
comprehension  is  200  syllables  per  minute. ^  Only  three  out  of  the 
forty  monologues  spoken  by  the  native -speakers  exceed  a  rate  of  200 
vocoids  per  minute  and  the  highest  rate  is  238  vocoids  per  minute. 

The  apparent  discrepancy  between  Marty’s  findings  and  those  of  the 
investigator  is  more  than  can  be  explained  by  mute  vowels.  One  must 
possibly  look  for  an  explanation  in  the  conditions  under  which  the 
measurement  was  made. 

2.  Oral  proficiency  is  developed  largely  by  practice.  Contact  with 
a  language  through  reading,  writing,  and  even  listening  contributes 
little  to  the  development  of  oral  proficiency.  The  advanced  non¬ 
native  group  was  composed  of  university  students  who  had  completed, 
at  least,  one  300-level  French  course;  that  is  to  say,  a  second  year 
course.  Many  students  in  the  sample  had  had  more  than  the  minimum. 
The  beginners  non-native  group  was  made  up  of  students  who  had  com¬ 
pleted  no  more  than  a  200-level  course;  that  is  to  say,  a  first -year 
course.  The  subjects  of  the  two  groups  differed  as  to  training  by 
at  least  one  French  course.  In  most  cases  they  differed  by  more  than 


2 Ibid. ,  p.  3. 
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that . 

The  advanced  group  should  have  had  the  advantage  of  higher  moti¬ 
vation  since  they  were  closer  to  becoming  fully-fledged  teachers  of 
French.  Some  were  back  at  university  after  having  taught  French  at 
the  high  school  level.  Still,  on  the  factors  measured,  the  advanced 
non-native  speakers  of  French  were  no  more  proficient  than  the 
beginners . 

One  is  led  to  conclude  that  everything  possible  should  be  done 
throughout  students'  university  years  to  give  them  the  oral  practice 
that  will  help  them  develop  greater  oral  proficiency.  Prospective 
teachers  of  French  whose  oral  proficiency  is  far  from  being  equal 
to  that  of  native  speakers  should  be  given  every  opportunity  during 
their  years  of  teacher  education  and  thereafter  to  continue  to 
develop  their  oral  proficiency.  Formal  language  instruction  could 
be  supplemented  with  mandatory  periods  of  study  in  a  French-speaking 
environment.  The  language  teacher  needs  to  be  orally  proficient. 

The  educational  system  that  hopes  to  develop  oral  proficiency  in 
students  by  using  teachers  who  are  not  orally  proficient  themselves 
can  expect  only  limited  success. 

A  second  explanation  possible  is  that  the  recent  lengthening  of 
the  language  sequence  and  the  introduction  of  language  laboratories 
in  high  school  is  reflected  in  the  superior  proficiency  of  the  B-2 
group.  Subjects  in  the  A-2  group  may  have  left  high  school  too  soon 
to  benefit  from  these  more  favorable  conditions. 

A  third  explanation  possible  is  that  complexity,  output,  and 
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hesitation  are  factors  of  oral  proficiency  that  develop  rapidly  in  the 
early  stages  of  language  acquisition  andmay  again  develop  in  an 
advanced  stage  of  language  acquisition.  Between  these  two  stages 
there  may  be  a  plateau  in  the  development  of  complexity,  output  and 
hesitation  while  development  accelerates  in  other  aspects  of  oral 
proficiency, 

3.  Children  of  French-speaking  parents  living  in  an  English-speaking 
environment  tend  not  to  acquire  a  native  proficiency.  In  the  native- 
speaker  sample  of  ten,  four  had  spent  an  important  part  of  their  lives 
in  a  predominantly  French  speaking  area.  Twenty-seven  out  of  thirty 
seven  who  completed  the  questionnaire  were,  according  to  their  per¬ 
sonal  evaluation,  more  proficient  in  English, 

The  language  which  the  members  of  the  sample  may  have  been  able 
to  control  fairly  well  in  writing  situations  was  often  nonstandard 
in  the  spontaneous  production  situation.  This  speech  was  non¬ 
standard  in  the  sense  that  an  educated  native  speaker  living  in  a 
predominantly  French  area  would  not  accept  it  as  "correct*1 ,  Native- 
speakers  do  not  always  speak  in  "correct"  well -formed  sentences.  They 
would  describe  many  of  their  own  utterances  as  ungrammatical.  However, 
some  of  the  deviances  found  followed  a  pattern.  There  were  deviations 
in  pronunciation  such  as  the  followings 

(a)  va  a  /  z/  un  Camp, 

(b)  trop  /z /  agreable, 

(c)  /fatsike/  for  fatigue. 


(d)  son  chameau  n'en  peut  £U 
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There  were  uninhibited  lexical  borrowings  such  as  these: 

(a)  le  pere  part  pour  1  "off ice0 

(b)  il  vente, 

(c)  de  le  ridiculer . 

(d)  peut-etre  seulement  que  des  hot -dogs  et  du  hamburger ° 

(e)  c*est  bien  le  fun. 

And  these  were  no  more  frequent  than  the  syntactical  entanglements, 
caiques,  vocabulary  problems  of  the  types  exemplified  here: 

(a)  peut-etre  en  cette  fagon. 
partent  tous  en  temps. 

(b)  aider  for  s "entreaider . 
couverte  for  couvertureo 
pardessus  for  audessus .  sur 

(c)  un  des  problemes  les  plus  difficiles  a  s*adapter  (hard  to  get 
used  to). 

(d)  seulement  que  les  effets  que  vous  avez  except i one 11 erne nt  de 
besoin  .  .  . 

esperant  que  peut-etre  £U*il  va  pleuvoir. 

il  faut  qu’il  y  ait  une  atmosphere  .  .  .  ou  que  l*on  aide  un  a 
1  * autre. 

It  is  the  nature  of  oral  proficiency  that  the  speakers  linguistic 
inadequacy  is  always  exposed.  While  the  native -speakers  possess  a 
proficiency  that  is  significantly  superior  to  that  of  the  non-natives, 
it  is  likely  that  a  sample  drawn  in  a  unilingual  area  would  have  dis¬ 
played  greater  proficiency  in  the  areas  measured. 
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If  one  assumes  that  some  subjects  in  the  native  sample  did  not 
quite  possess  native  proficiency,  none  of  the  conclusions  of  this 
study  are  negated.  With  a  native  group  of  higher  proficiency,  the 
differences  between  natives  and  non-natives  would  only  have  been 
greater. 

These  observations  all  lead  to  the  following  conclusion:  If  the 
development  of  oral  proficiency  is  to  be  an  important  objective  of 
language  teaching , a  concerted  and  amplified  effort  must  take  place 
to  develop  this  facility  in  prospective  teachers. 

4.  The  monologues  spoken  after  listening  to  another  monologue  on  the 
same  topic  and  with  complete  freedom  given  to  the  speaker  to  repeat 
exactly  the  same  content  in  the  same  form  can  be  considered  as  a  test 
of  ability  to  recall  language  just  heard  rather  than  as  a  test  of 
ability  to  improvise  or  compose  orally.  It  could  be  called  parrot- 
ting  . 

What  qualifies  one  as  a  fluent  speaker  is  not  the  ability  to  imitate 
previously  heard  sentences  but  rather  the  ability  to  produce  and 
understand  sentences  never  before  encountered.  The  striking  fact 
about  the  use  of  language  is  the  absence  of  repetit ion--almost 
every  sentence  uttered  is  uttered  for  the  first  time.^ 

There  is, however,  little  evidence  that  parrotting  does  take  place 

under  the  conditions  that  were  created.  It  seems  that  parrotting 

would  require  more  exposure  to  the  stimulus  to  permit  memorization. 

From  a  single  exposure  to  a  type  of  speech,  one  is  not  influenced 

greatly  to  use  the  type  of  language  structures  heard.  The  complexity 

3 

Jerrold  J.  Katz  and  Jerry  A.  Fodor,  ’’The  Structure  of  a  Semantic 
Theory,"  The  Structure  of  Language,  Katz  and  Fodor,  editors  (Englewood 
Cliffs:  Prentice  Hall  Inc.,  1964),  pp.  481-482. 
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of  language  spoken  remains  highly  personal.  The  speaker  remembers 
the  ideas  heard  with  much  more  ease  than  he  remembers  the  language 
structures. 

The  fear  that  oral  proficiency  is  largely  a  reflection  of  intel¬ 
ligence  may  not  be  justified.  It  seems  that  by  providing  ideas  to 
avoid  taxing  the  intelligence  and  the  memory  of  the  speaker  that  it 
is  possible  to  observe  the  normal  proficiency  of  the  speaker.  It  is 
obvious  that  the  speaker  who  has  nothing  to  say  will  not  manifest  any 
proficiency  but  the  converse  is  not  necessarily  true.  Given  ideas  to 
express,  not  everyone  will  express  them  with  equal  facility.  Oral 
proficiency  can  then  be  isolated  for  observation. 

The  responses  to  the  stimuli  made  by  the  native  and  non-native 
speakers  differed  in  kind.  The  native -speaker  was  inclined  to  com¬ 
ment  on  the  stimuli.  A  common  reaction  to  the  description  of  a  rain¬ 
storm  in  the  desert  was  to  comment  on  the  unusual ness  of  such  an 
event.  Faced  with  a  series  of  pictures  describing  the  full  day  of 
the  housewife,  he  commented  that  it  was  debatable  whether  housewives 
led  a  hard  life. 

The  non-native  was  more  likely  to  repeat  the  ideas  just  heard 
without  criticizing  them.  Failing  that,  he  was  more  likely  to  take 
an  absolutely  unrelated  subject  and  ignore  the  subject  completely. 

For  example,  the  stimulus  about  cheaters  in  the  classroom  brought 
forth  a  discussion  about  school  friendships,  and  the  depiction  of  a 
storm  in  the  desert  brought  forth  a  description  of  dawn  in  an  African 
country.  Others  who  did  not  understand  key  words  in  a  stimulus  (for 
example,  the  word  trlcheur)  were  able  to  weave  an  interesting  web 
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using  this  word  without  betraying  completely  their  lack  of  under¬ 
standing  of  its  meaning , 

The  more  proficient  speakers  therefore9  shows  more  flexibility  and 
adaptability  in  his  thinking  in  response  to  a  stimulus,,  This  may  be 
a  factor  of  proficiency  that  bears  further  investigation,, 

7.  Why  is  it  that  oral  stimuli  cause  more  hesitation  than  visual 

stimuli?  And  why  is  it  that  visual  stimuli  are  more  fertile  than  oral 
stimuli?  Cattell  almost  a  century  ago  concluded  that  linguistic 
reaction  to  a  written  word  was  faster  than  reaction  to  a  picture.^ 
Might  not  one  expect  that  reaction  to  a  spoken  word  would  be  even 
faster  than  reaction  to  a  written  word? 

Some  differences  between  the  experimental  conditions  created  by 
Cattell  and  those  in  this  study  should  be  noted,  Cattell *s  experi¬ 
ment  called  for  isolated  word  response 9  while  the  investigator  in 
this  study  called  for  a  response  in  integrated  language.  In  Cattell ®s 
experiment  the  written  or  visual  stimulus  was  the  cue  for  an  immediate 
response.  In  this  study  the  subject  was  given  one  minute  to  inter¬ 
pret  the  visuals  before  beginning  to  speak.  The  visuals  were  left 
before  him  so  that  the  memory  burden  was  almost  non-existent.  On  the 
other  hands  the  one-minute  interval  between  the  oral  stimulus  and  the 
response  was  time  for  forgetting  as  well  as  for  planning. 

Another  possibility  is  that  there  is  a  linguistic  conflict  between 
the  linguistic  form  of  the  stimulus  and  the  preferred  style  of  the 
speaker.  This  conflict  results  in  hesitation  or  low  production  by  the 

4Je  Cattell g  ^Experiments  on  the  Association  of  Ideas Mind 
12(1887) s  P.  68, 
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speaker o  On  the  other  hand  the  visuals  may  suggest  ideas  without 
setting  up  linguistic  interference* 

IV *  CONCLUSIONS  ABOUT  EVALUATION  OF  ORAL  PROFICIENCY 

1.  Speech  contains  more  vocoids  than  words  and  more  words  than  pre¬ 
dicates*  The  correlation  among  the  output  of  these  three  elements  is 
very  high.  Still  a  count  of  vocoids  is  a  better  discriminator  of  out¬ 
put  than  a  count  of  predicates*  Since  predicates  are  much  easier  to 
count  than  vocoids  and  since  differences  on  this  factor  are  highly 
significant  in  either  case,  a  count  of  predicates  is  more  than 
adequate  except  where  fine  discrimination  is  desired* 

2.  Since  rate  of  output  is  the  better  discriminator  with  an  arid 
stimulus  and  frequency  of  hesitation  is  the  better  discriminator  with 
a  fertile  stimulus*  there  is  reason  to  believe  that  rate  of  output 
would  be  a  suitable  metric  in  the  evaluation  of  beginners  and  frequency 
of  hesitation,  in  the  evaluation  of  advanced  speakers. 

3.  Because  stimuli  differ  markedly  in  fertility,  stimuli  used  in 
tests  should  be  matched  in  this  respect*  Fertility  of  a  stimulus 
should  be  determined  empirically  for  each  population* 

4.  Since  the  effectiveness  of  an  oral  stimulus  depends  upon  its  being 
understood  by  the  speaker,  and  since  even  experienced  teachers  are 
poor  judges  of  the  comprehension  problems  found  in  a  stimulus,  the 
comprehensibility  of  a  stimulus  to  be  used  in  a  test  needs  to  be 
determined  empirically. 

5.  Because  it  is  difficult  to  match  stimuli  as  to  their  effect  on 
response,  it  is  important  that  subjects  being  compared  by  means  of  an 
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oral  test  respond  to  the  same  stimuli.  Facilities  permitting  the 
administration  of  tests  to  large  groups  in  one  sitting  are  then  desi¬ 
rable  for  test  security  reasons. 

In  this  respect,  language  laboratories  can  be  very  useful.^  If 
they  are  not  designed  with  playback  facilities  for  every  student 
position,  they  should  have  at  least  recording  facilities  for  every 
position.  Large  systems  not  willing  to  provide  such  elaborate  faci¬ 
lities  in  every  school  could  equip  one  school  to  which  the  students 
could  be  transported.  Another  possibility  is  portable  recording 
equipment  that  could  be  connected  to  existing  laboratory  facilities 
in  several  of  the  schools. 

6.  The  reliability  of  the  results  of  oral  examinations  depends  upon 
standard  administration  procedures.  Where  any  part  of  the  stimuli  is 
to  be  presented  orally,  it  would  seem  that  uniformity  can  be  gua¬ 
ranteed  only  by  recording  the  stimuli  for  presentation. 

7.  Skills  may  be  tested  synthetically  or  analytically.  In  synthetic 
testing,  the  subject  is  called  upon  to  use  his  skill  and  he  is  judged 
on  an  overall  subjective  impression  of  his  performance.  In  analytical 
testing  the  skill  is  broken  down  into  as  many  elements  as  possible 
each  of  which  may  be  judged  on  a  binary  scale  as  to  acceptability 

of  performance. 

Mackey  suggests  that  synthetic  evaluation  has  the  following 
weaknesses 

^Robert  R.  Roy,  "A  Descriptive  Study  of  Language  Laboratories  and 
of  their  Use  in  the  Teaching  of  French  as  a  Second  Language  in  Manitoba 
Secondary  Schools'*  (unpublished  Master* s  thesis.  University  of  Manitoba, 
1965),  p.  75. 

^William  F.  Mackey,  Language  Teaching  Analysis  (Londons  Longmans, 
Green  &  Co.  Ltd.,  1965),  pp.  406-407. 
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(a)  The  subject  reveals  only  what  he  wishes  to  reveal. 

(b)  Synthetic  evaluation  does  not  adequately  sample  range  of  voca¬ 
bulary  and  structures  controlled. 

(c)  This  technique  makes  it  easier  for  a  subject  to  plug  in  a  pre¬ 
pared  composition. 

(d)  Scoring  is  inaccurate  ,  t ime-ccnsuming ,  subjective,  and  difficult. 

(e)  Such  tests  are  of  limited  diagnostic  value. 

He  suggests  on  the  other  hand  that  a  weakness  of  analytic  tests 
is  that  they  do  not  require  the  learner  to  use  ’’the  entire  complex 
system  of  habits  simultaneously".  But  is  there  another  weakness? 

Do  testers  know  enough  about  the  nature  of  proficiency  to  make  a 
complete  inventory  of  its  elements?  If  they  do  not,  is  it  possible 
that  the  incompleteness  of  analytic  tests  accounts  for  the  permanence 
of  synthetic  tests  in  spite  of  their  inadequacies?  As  test  con¬ 
structors  obtain  more  and  more  information  about  the  specific  elements 
to  be  tested,  the  need  for  the  synthetic  tests  should  decrease. 

Tests  which  are  designed  to  cause  a  subject  to  use  a  series  of 
specific  lexical,  morphological,  or  phonological  items  are  not  the 
only  type  of  analytical  tests.  Tests  which  measure  factors  of  pro¬ 
ficiency  such  as  language  complexity,  rate  of  output,  or  frequency  of 
hesitation  from  a  monologue  produced  under  controlled  conditions  are 
also  analytical.  If  analytical  tests  are  to  give  a  complete  evalu¬ 
ation  of  oral  proficiency,  they  have  to  include  production  in  which 
the  subject  is  required  to  use  several  habits  simultaneously  and  to 
select  the  habits  that  are  pertinent  in  a  given  situation.  From  such 
a  production  the  evaluator  selects  the  very  specific  elements  that  he 
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is  testing  and  measures  them  against  an  established  quantitative 
standard#  Continued  research  is  needed  to  identify  these  elements. 

Tests  of  oral  proficiency  that  call  only  for  the  production  of 
isolated  words,  phrases  or  even  sentences  are  incomplete.  Tests  of 
oral  proficiency  that  closely  determine  in  every  part  of  the  test  the 
structures  and  vocabulary  to  be  used  are  also  incomplete.  Part  of  a 
complete  test  of  oral  production  calls  upon  a  subject  to  produce  mono¬ 
logues  and  possibly  dialogues.  The  language  produced  in  such  situ¬ 
ations  is  rated  for  very  specific  factors  that  are  not  likely  to  be 
demonstrated  otherwise. 

For  reasons  of  economy  of  administration  time  it  may  be  entirely 
possible  to  rate  the  use  of  certain  high  frequency  phonological, 
morphological,  or  lexical  items  from  these  same  productions.  But 
because  many  language  elements  are  not  frequent  or  constant  in  usage, 
they  have  to  be  tested  in  items  designed  to  force  their  use. 

Tests  of  oral  proficiency  then  need  to  include  some  pointed  and 
specific  items  that  elicit  only  one  acceptable  answer  and  other  types 
of  items  where  the  speaker  is  given  some  linguistic  freedom  to  deter¬ 
mine  how  successful  he  is  in  dealing  with  a  linguistic  situation 
where  he  has  the  freedom.  Restrictions  set  by  directions  or  stimuli 
have  a  negative  effect  on  fluency.  The  Mfree”  production  sections 
are  analyzed  for  very  specific  qualities  and  are  not  rated  sub¬ 
jectively  on  some  arbitrarily  selected  scale  used  to  evaluate  some 
vague  quality.  It  seems  that  subjective  scales  used  to  rate  broad 
qualities  such  as  intelligibility  and  naturalness  should  be  replaced 
by  ratings  of  more  specific  elements.  The  subjective  categories  have 
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to  be  broken  down  into  specific  components.  At  the  advanced  stages 
of  language  learning,  tests  should  sample  as  great  a  variety  of  lan¬ 
guage  elements  as  possible.  Beginners  should  be  tested  on  the  most 
frequent  elements  without  consideration  of  their  supposed  relative 
difficulty.  If  oral  proficiency  scores  are  to  have  a  meaning  that 
could  be  verified  in  real-life  situations,  they  should  reflect 
particularly  the  control  of  the  high  frequency  elements.  If  economy 
dictates  that  there  be  only  one  or  two  questions  on  any  element, 
the  questions  based  on  the  high  frequency  elements  should  be  given 
a  heavier  weighting, 

8,  One  minute  seems  to  be  an  appropriate  length  for  a  monologue  pro¬ 
duction  if  only  linguistic  aspects  are  under  investigation.  Shorter 
productions  are  insufficient  and  longer  productions  place  a  higher 
premium  on  non-linguistic  factors.  But  low  frequency  elements  of 
language  cannot  be  rated  in  free  monologues. 

9.  Visual  stimuli  are  to  be  preferred  to  oral  stimuli  where  both  are 
possible.  Because  visual  stimuli  are  more  fertile  than  oral  stimuli, 
they  should  result  in  a  better  display  of  proficiency. 

10.  It  is  likely  that  there  is  an  aspect  of  oral  proficiency  manifested 
in  conversation  that  is  not  demonstrated  in  monologue  production. 
Conversation  often  calls  for  quick  reaction  and  frequent  shifting 

of  direction.  The  characteristics  that  are  demonstrated  only  in 
conversation  need  to  be  identified  and  tested.  But  that  is  not  to  say 
that  they  will  necessarily  have  to  be  tested  in  a  conversation. 

11.  In  test  items  that  control  strictly  the  subject*s  responses,  economy 
of  scoring  time  is  likely  the  only  consideration  in  deciding  whether 
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to  count  wrong  answers  or  right  answers.  However,  in  free  responses 
it  seems  that  the  proficient  can  be  singled  out  better  by  counting 
instances  of  inappropriate  performance.  It  seems  that  the  subject 
lacking  in  proficiency  excels  at  not  performing  rather  than  at  per¬ 
forming  inappropriately. 

12.  One  of  the  dangers  of  using  monologues  to  test  certain  aspects  of 
oral  proficiency  is  that  a  subject  may  be  able  to  use  a  few  prepared 
compositions  to  speak  on  a  great  variety  of  subjects.  Although  being 
able  to  prepare  a  few  topics  well  and  to  link  them  in  speech  with  a 
topic  proposed  does  indicate  a  certain  degree  of  proficiency,  it 
would  seem  wise  to  demand  that  monologue  response  be  definitely 
within  set  bounds. 

The  oral  test  is  not  the  most  efficient  way  to  sample  range  of 
vocabulary.  A  written  test  could  be  much  more  complete  and  econo¬ 
mical  of  administration  and  scoring  time.  Therefore  the  need  to  test 
vocabulary  should  not  dictate  a  narrow  specification  of  the  areas  of 
performance  in  monologues.  It  may  be  that  giving  a  subject  conside¬ 
rable  freedom  as  to  what  he  says  may  only  make  it  possible  for  him 
to  display  his  proficiency  at  its  best.  It  seems  that  the  best  test 
of  oral  proficiency  is  one  that  favors  production  and  not  one  that 
places  obstacles  in  its  path. 

13.  The  good  oral  test  states  in  precise  terms  what  is  to  be  measured 
and  by  what  metric.  Scorers  need  to  be  trained  for  the  job.  It  is 
likely  that  educated  native -speakers  can  be  easily  trained  to  do  this 
job  even  if  they  have  no  teaching  experience  or  training.  By  using 
non-certif ied  personnel  to  do  this  work,  qualified  teachers  can  be 
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freed  for  more  teaching. 

Tests  should  be  recorded  so  that  a  single  monologue,,  for  instance, 
can  be  scored  for  its  demonstration  of  command  of  several  elements  or 
for  reconsideration  in  case  of  doubt. 

The  language  laboratory  should  be  planned  so  that  the  student 
responses  are  recorded  in  succession  on  long  tapes,  with  brief 
identification,  no  pauses  and  no  recording  of  directions  or 
questions  so  that  the  scorer  will  waste  a  minimum  of  time  in  tape 
handling.  If  the  laboratory  is  not  so  designed,  one  should  consider 
the  economy  of  using  a  less  highly  trained  person  to  edit  the  subject 
responses  and  group  them  on  continuous  tapes. 

14.  Subjects  trying  to  produce  a  monologue  may  suffer  emotional  blocks, 
associat ional  interferences,  or  memory  lapses.  It  has  long  been 
known  that  many  students  encounter  these  same  problems  when  they 
write  examinations.  This  problem  has  not  been  solved  for  written 
examinations  any  more  than  for  oral  tests. 

Increasing  the  number  of  practice  items,  making  sure  that  the 
subject  is  at  home  with  the  electronic  equipment,  finding  more 
intense  stimuli,  and  giving  more  privacy  to  the  speaker,  all  are 
ways  of  decreasing  the  frequency  of  emotional  blocks.  The  pro¬ 
vision  of  rich  visual  stimuli  should  solve  most  of  the  memory 
problems. 

Because  even  with  the  greatest  caution  these  interferences  are 
still  likely  to  appear,  it  would  seem  unwise  to  base  judgment  on 
a  single  monologue  per  subject.  Possibly  several  monologues  should 
be  called  for  but  only  the  best  one  counted. 
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.5*  There  is  no  known  substitute  for  a  test  of  oral  proficiency.  A 

complete  evaluation  of  linguistic  development  must  include  a  test  of 
oral  proficiency. 

V.  SUGGESTIONS  FOR  FURTHER  RESEARCH 

1.  Research  must  continue  to  identify  more  factors  of  proficiency, 

to  assess  the  importance  of  these  factors  to  the  native  listener,  and 
to  test  their  relative  importance.  Parallel  samples  of  speech 
differing  in  only  one  aspect  could  be  played  to  groups  of  native 
listeners  and  their  effect  could  be  assessed  by  tests,  questionnaires, 
and  interviews. 

2.  This  study  could  be  duplicated  by  creating  visual  stimuli  about 
a  desert  storm  and  cheating  in  school  and  oral  stimuli  about  a 
housewife* s  day  and  camping  problems  to  find  out  if  the  conclusions 
about  the  different  effects  of  oral  and  visual  stimuli  are  well 
founded  or  if  the  effects  noticed  can  be  attributed  to  the  topics 
of  the  stimuli. 

3.  This  study  used  university  students  as  subjects.  A  study  com¬ 
paring  the  proficiency  of  early  high  school  students  with  advanced 
university  students  would  provide  information  useful  in  testing 
beginners  in  second-language  study. 

4.  A  better  comparison  of  the  effect  of  oral  and  visual  stimuli 
could  be  gained  from  a  study  that  would  remove  the  visual  stimuli 
as  well  as  the  oral  stimuli  from  the  speaker  one  minute  before  he 
starts  speaking. 


5 


A  useful  study  would  be  one  that  would  explore  whether  the  various 
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aspects  of  proficiency  develop  at  different  rates. 

6*  The  unique  characteristics  of  oral  proficiency  in  conversation 
should  be  identified. 

7.  Complexity  is  known  to  be  a  factor  of  proficiency.  An  investi¬ 
gation  is  needed  to  determine  what  is  the  most  suitable  metric  of 
complexity. 

8.  The  possibility  of  testing  every  type  of  problem  without  trans¬ 
lation  should  be  investigated. 

9.  The  test  constructor  still  has  to  depend  largely  on  unscientific 
observation  and  on  his  own  contrastive  analysis  to  select  the 
problems  of  inter-language  interference  and  to  establish  an  order 
of  relative  importance  for  the  various  phonological,  morphological 
and  syntactical  elements  of  language. 

10,  The  subjects  of  the  four  language  methodology  classes  from  which 
the  samples  were  drawn  were  predominantly  female.  If  these  classes 
are  representative  of  language  methodology  classes  generally,  one  can 
expect  a  large  proportion  of  language  teachers  to  be  female.  The 
social  or  psychological  reasons  for  this  imbalance  between  the 
proportion  of  male  and  female  language  teachers  should  be  investigated 
There  is  also  need  to  study  the  effect  of  the  predominance  of  females 
among  language  teachers  on  the  success  of  male  language  learners. 

The  male  adolescent,  for  example,  who  attaches  great  importance  to 
physical  robustness  may  find  it  difficult  to  accept  the  degree  of 
identification  with  the  teacher  required  during  oral  practice  periods. 
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APPENDIX  A 

"ORAL  PROFICIENCY  TEST  SUBJECTS"  QUESTIONNAIRE 


1  •  Name  _ _ _ _ 

2.  Address  ___ _ _____ 

3.  Phone  _  4.  Subject  number  _  5.  Date  _ 

6.  What  language  did  you  first  speak?  English 

French 

Other 

7.  What  language  do  you  speak  with  the  most  ease  now?  English 

French 

Other 


8.  Training  in  French* 

School 

Grade  Hours  per  day 

I  ......  .  _ 

II . . 

III . . 

IV . . 

V . . 

VI . . 

VII . . 

VIII . . 

IX . . 

X . . 

XI . . 

XII . . 


University 

Year  Number  of  literature  or 

language  courses 

I . . 

II . . 

III . . 

IV . . 

V . . 

VI . . 

VII . . 


XIII 


■ 


... 


e  aabbA  .  £ 


■ 


X 


■ 


:r*©Y 


II 


•  •••••»  1*1 
*  ■  *  .  •  •  #  •  VI 


J: 


V  ,  Piiiori 


t.  ;  t.. 


II 


•  •  •  •  •  •  •  II. I 
•••••••Vi 


1 1  V 


IV 
IIV 
II IV 
XI 


IX 


IIX 


IIIX 
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9.  Training  in  English* 


Grade 

I  . 
II  . 
Ill  . 


School 


Hours  per  day 


IV 


Year 

I  , 
II  , 
III  < 
IV  , 


University 

Number  of  literature  or 
language  courses 


VI 


VII 


VIII 


IX  . 


X 

XI 

XII 

XIII 


VI 


VII 


10.  How  much  French  and  /  or  English  do  you  use  in  your  personal  life 


now? 


.44;!*,,'.  v-i, 
to  otulz^o 31 lo  lednuH 


««.»*•»' 


•  •  •  «  •  « 


•  •  •  •<«  •  •  •  VI 


IV 

IIV 


X 


3bci0 


.  ...  II 


....  VI 

•  ••  * 


.  .  «  IV 


IIV 

HIV 


.  .  .  .XI 
.  •  . .  .  X 


IX 


I IX 


.  •  .  .  IIIX 


f  n  -  '■  tor..  •  i  ov  .081.  ufy  y  '  •  .>  io  \  bra  rf.>m  4  d  >.  -»  •  01 


— 


* - - - 


rvuii 


— 
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APPENDIX  B 
MEASURING  INSTRUMENT 

Directions  for  Recording  from  Oral  and  Visual  Stimuli 

Afin  de  pouvoir  determiner  comment  les  gens  sfexpriment,  on  va 
vous  demander  d*enregistrer  quatre  monologues  d*une  minute  sur  quatre 
sujets  differents.  Eff orcez-vous  de  rester  dans  le  cadre  des  sujets 
proposes.  Les  premier  et  deuxieme  monologues  que  vous  aurez  a  dire 
seront  precedes  d*une  histoire  dont  vous  tacherez  de  vous  inspirer.  Les 
troisieme  et  quatrieme  monologues  seront  accompagnes  d*une  serie  d* images 
destinees  a  vous  inspirer. 

N’essayez  pas  de  retenir  toutes  les  idees  fournies  ou  de  parler 
de  chacune  des  images.  Vous  pouvez  organiser  vos  idees  dans  l*ordre 
que  vous  preferez.  II  faut  que  vous  vous  sentiez  libre  d’exprimer  des 
idees  originales  sur  les  sujets  proposes  et  de  les  grouper  comme  bon 
vous  semblera. 

On  vous  demande  d’user  d'un  langage  familier.  Imaginez  que  vous 
parlez  a  quelqu’un  que  vous  connaissez  bien.  Dites  tout  ce  que  vous 
pourrez  pendant  l*intervalle  donne.  Ne  cherchez  pas  a  dire  des  choses 
extraordinaires ,  mais  parlez  le  plus  possible. 

Voici  un  exemplei  Ecoutez  ce  qu*un  des  voisins  a  a  dire  au 
sujet  du  petit  Fran$ois  et  soyez  pret  a  parler  pendant  une  minute  sur 
le  meme  sujet.  Ce  premier  monologue  ne  sera  pas  enregistre.  II  servira 
simplement  d*exercice. 

Le  petit  Franjois  aime  bien  crier.  Ce  bebe  est  mon  voisin.  II 
ne  crie  que  la  nuit  entre  11  heures  du  soir  et  5  heures  du  matin. 

Pour  le  faire  taire,  sa  mere  crie  et  son  pere  hurle.  Le  plus  triste 
c*est  que  le  docteur  a  dit  que  c*etait  tres  bien  ainsi  car  il  se 
faisait  les  poumons.  II  fera  un  chanteur  d*opera.  Pour  1* instant 
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la  famille  chez  nous  ne  dort  plus.  Je  baflle  en  classe  (je  m'en 
excuse).  Papa  s*endoi1t  au  bureau  et  maman  fait  la  sieste.  Tout 
9a  a  cause  de  ce  mioche.  Quand  on  a  proteste  aupres  des  parents , 
ils  ont  dit  qu’ils  le  laissaient  pleurer  pour  queil  n*ait  pas  de 
complexes  plus  tard.  C'est  dur  pour  nous.  C*est  dramatique 
d'avoir  un  tyran  comme  voisin. 

Maintenant,  en  attendant  le  signal  de  commencer  a  parler,  pensez 
a  ce  que  vous  allez  dire  au  sujet  du  petit  Fran9ois.  Commencez  dans  1 
minute  quand  ce  signal -ci  *  vous  sera  donne.  (1  minute)  *  (1  minute)  *. 
Arretez-vous  toujours  quand  vous  entendez  le  signal  que  vous  venez 
d* entendre. 

(OSS)  Le  monologue  suivant  a  pour  sujet  un  orage  dans  le  desert. 
Ecoutez  bien,  puis  reflechissez  en  attendant  qu*on  vous  demande,  a  vous, 
de  parler  d'un  orage  dans  le  desert. 

(OSS  stimulus) 

Six  heures  du  matin.  Pas  un  souffle  d*air.  Un  des  chameaux  lance 
un  cri.  Une  antilope  surgit,  se  heurte  la  tete  contre  un  rocher. 

A  l'horizon  il  y  a  des  signes  d'orage.  Le  sable  et  la  poussiere 
tourbillonnent .  Les  canards  sauvages  poussent  des  cris.  II  faut 
chercher  un  abri.  Au  dessus  de  ma  tete  je  vois  les  marques  de  la 
derniere  inondation.  Les  eaux  vont  remonter  a  cette  hauteur-la.  II 
n'y  a  pas  un  instant  a  perdre.  Les  chameaux  s *agenouillent .  Chacun 
se  perche.  Le  soleil  djsparaft.  Les  eclairs  dechirent  l*obscurite. 
Un  coup  de  tonnerre  retent it  et  d*enormes  gouttes  commencent  a 
tomber.  Nos  vetements  collent  a  notre  peau.  Une  fente  s*ouvre  dans 
la  muraille;  nous  atteignons  une  terrasse.  Les  eaux  remuent  a  nos 
pieds.  Les  flots  font  crouler  les  murailles.  Enfin  un  rayon  de 
soleil.  L*orage  est  fini. 

Bon,  maintenant  pensez  un  peu  a  ce  que  vous  allez  dire.(l  minute). 
Magnetophone  en  marche  et  commencez  au  signal.  *  (1  minute)  >v  Arretez, 
s'il  vous  plait. 

(OCS)  On  va  maintenant  vous  demander  de  parler  de  ceux  qui 
trichent  en  classe.  Mais  ecoutez  d*abord  ceci! 

(OCS  stimulus) 

Les  tricheurs  representent  un  probleme  pour  leurs  camarades  de 
classe  qui  se  demandent  parfois  quelle  attitude  ils  doivent  adopter 


*  Bell 
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vis  a  vis  d'eux.  Faut-il  les  denoncer?  Faut-il  jouer  leur  jeu?  Les 
denoncer  au  professeur,  je  ne  le  pense  pas.  Une  classe  est  une 
petite  communaute  ou  l’on  doit  se  sentir  solidaire  les  uns  des  autres. 
Rapporter  et  ddnoncer  demoliraient  1 ’esprit  d’dquipe  et  de  bonne 
camaraderie  qui  doit  regner  dans  ce  groupe  et  cr^eraient,  d'autre 
part,  une  lourde  et  pdnible  atmosphere  de  suspicion.  Le  rapporteur 
risquerait  de  se  faire  ddtester  par  la  classe  entiere.  Done  pas  de 
rapport age.  Mais  on  peut  par  quelques  mots  ou  s implement  par  une 
mimique  expressive  faire  savoir  au  tricheur  que  l’on  n’est  pas  dupe 
de  son  manege.-  Cela  peut  suffire  a  le  decourager. 

Vous  avez  quelques  instants  pour  penser  &  ce  que  vous  allez  dire. 

(1  minute)  Magnetophone  en  marche.  Commencez.  *  (1  minute)  *  Arretez, 
s’il  vous  plait. 

(VSS)  Prenez  maintenant  la  sdrie  d' images  au  sujet  de  la  journee 
d’une  mere  de  f  ami  lie.  Vous  aurez  une  minute  pour  repondre  a  la  question: 
Que  fait  une  mere  de  f  ami  lie  pendant  le  journde?  Vous  n’avez  pas  besoin 
de  parler  de  chaque  image  ou  de  les  prendre  dans  l’ordre  donne.  Vous 
pouvez  aussi  ajouter  les  idees  que  vous  voulez.  Avant  qu’on  vous  donne 
le  signal  de  commencer  prenez  un  instant  pour  regarder  les  images. 

(1  minute)  Voulez-vous  commencer?  *  (1  minute)  *  Arretez,  s’il  vous 
plait. 


(VCS)  Vous  avez  devant  vous  une  serie  d’ images  au  sujet  du 
camping.  Elies  sont  sen sees  vous  aider  a  parler  des  problemes  que 
pose  le  camping.  Les  gravures  sont  offertes  tout  simplement  pour  vous 
suggdrer  des  idees  et  non  pas  vous  imposer  des  limites.  Prenez  un 
instant  pour  decider  de  ce  que  allez  dire.  (1  minute)  Magnetophone 
en  marche  et  commencez  s'il  vous  plait.  *  (1  minute)  *  Voulez-vous 
arreter  votre  machines  maintenant. 
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APPENDIX  C 

DIRECTIONS  FOR  MONOLOGUE  PRODUCTION 

In  an  effort  to  find  out  how  people  talk,  we  will  ask  you  to 
record  four  one-minute  monologues  on  four  different  topics.  So  that 
you  don’t  have  to  worry  about  what  to  say,  you  will  be  given  four 
definite  topics  to  speak  on*  In  addition  before  two  of  these  monologues, 
you  will  be  invited  to  listen  to  something  on  the  same  subject  as  you 
are  going  to  speak.  To  help  you  do  the  other  two,  you  will  be  shown  a 
series  of  pictures  suggestive  of  ideas. 

You  do  not  need  to  try  to  remember  all  of  the  ideas  you  hear  or 
to  talk  about  all  the  pictures  you  see.  You  do  not  need  to  talk  about 
the  ideas  and  pictures  in  the  order  in  which  they  were  presented.  You 
should  feel  free  to  add  ideas  of  your  own  or  to  modify  those  presented. 
However,  you  are  asked  to  keep  to  the  subject  as  much  as  possible. 

When  you  are  speaking,  imagine  you  are  talking  to  someone  with 
whom  you  are  at  ease  because  we  want  your  language  to  be  as  natural  as 
possible.  Do  not  try  to  be  formal  in  your  style.  But  in  order  to 
produce  as  large  a  sample  of  speech  as  possible,  please  say  as  much  as 
you  can  between  the  stopping  and  starting  signals. 

After  each  topic  is  presented  you  will  be  given  a  few  moments  to 
organize  your  thoughts.  The  directions  will  be  given  orally  and  in 
French.  The  directions  you  have  just  read  will  be  repeated.  Now  just 
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APPENDIX  D 
VISUAL  STIMULI 


...  .. 


Journee  dune  Mere  de  FamilLe 


Le  Camping 
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NAMES 


Group 

1.  _ 

2.  _ 

3.  _ 

4.  _ 

5.  __ 

6*  _ 

7.  __ 

8.  _ 
9  4  __ 


APPENDIX  E 

STIMULI  ROTATION  SHEET 

(1)  OSS  (2)  OCS  (3)  VSS  (4)  VCS 
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APPENDIX  F 

TRANSCRIPTIONS  OF  MONOLOGUE  RESPONSES 

Legend 

1*  Structures  of  modification  are  underlined.  An  arrow  at  the  end  of  a 
line  indicates  that  that  structure  continues  on  the  next  line.  An 
arrow  at  the  beginning  indicates  that  it  started  on  the  previous  line. 
The  structures  are  identified  by  M,  F,  or  S  in  the  right  margin. 

2.  An  x  above  the  line  -  noun  determiner. 

3.  An  o  above  the  line  -  preposition  or  conjunction. 

4.  An  *  above  the  line  -  pronoun. 

5.  A  £  above  the  line  -  predicate. 

6.  A  number  above  the  line  -  vocoids  in  that  sentence. 

7.  A  number  below  the  line  -  a  point  of  hesitation.  The  number  indicates 

the  type  of  hesitation:  (1)  noun-lexical  intrusive  sound,  (2)  sent¬ 
ence  correction,  (3)  word  change,  (4)  repetition,  (5)  stutter,  (6) 
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difficile  a  s* adapter  est  celui  des  elements*  La  per sonne  doit 
'  ^  x  : 

p  p 

peut  rencontrer  soit  une  une  pluie  ou  geler  comme  un  eskimo 

4  1 

P  p  32 

ou  rencontrer  des  vents  qui  sont  pas  trop  agreables.  En  plus\ 

1  9  - 1  ' 


xde  de  la  temperature  les  insectes  peuvent  faire  la  la  visite  ou 
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la  vacance  de  la  visite  ou  de  la  vacance  un  peu  de 
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de  problemes  aussi .  (79) 
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x  ox  o  8  ox  oox  x 

La  journ4e  d*une  mere  de  f  ami  lie.  Du  matin  iusq^au  solr  la  FFFF 


o  x  o  p  x  24  * 

mere  de  famille  est  tres  occupp4e  a  entretenir  sa  maisoru  Elle  FMS 


*  p  o  x  px  ox  o 

se  leve  de  bonne  heure.  prepare  le  dejeuner  pour  sa  famille  et  FMF 


po*p  *  o  ox  ox  31 

volt  qu'ils  partent  tous  en  temps  pour  le  travail  ou  lt4cole>  FFF 
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*  *  Opx  oo  px 

Ensuite  elle  s'occuppe  a  faire  le  lavage  et  a  entretenir  sa  M 
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19  *  P  x  opox  p 

maison.  Elle  a  aussi  du  rdparage  a  faire  et  les  re pas  prennent  MS 

4  9 

o  x  20  *  p  x  p 

beaucoup  de  son  temps .  Elle  peut  entretenir  le  jardin,  faire  F 

—  x 

X  o  ox  p  X  o 

un  peu  de  lecture  dans  ltapres-midi »  dcrire  des  lettres  mais  FF 
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o  o  *  p  o  o  *  p  37  x 

de  plus  en  plus  elle  a  ir.oirts  de  temps  pout  se  divertir.  Le  FS 
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soir  lorsque  toute.  (110) 
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(6)  temps  (7)  ensuite  (8)  voit  (9)  famille  (10)  mere  (11)  _  (12) 

(13)  pour  (14)  heure  (15)  temps  (16)  _  (17)  elle  a  (18)  occuppde 

(19)  Elle  •  .  ,  divertir.  (20)  _ 
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Un  orage  dans  le  ddsert.  Beaucoup  de  choses  nous  disent  qu*il  FF 


P  15  p 

y  a  qu*til  va  y  avoir  un  orage.  Les  animaux  en  ressentent 
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aussi  l’effet.  Les  nuages  sont  bas  et  gris  et  le  soleil  dis-  M 


p  15  p  p  10 

parait  bientot .  Le  sable  tourbillone  et  le  vent  s*eleve.  M 


P  P 

L*antilope  surgit  mais  aussitot  se  heurte  la  tete  contre  un  M 


17  P 

rocher.  II  faut  se  trouver  un  abris  avant  que  l’orage  com 


p  15  p  p  13 

mence.  Nous  cherchons  et  bientot  une  muraille  est  devant  nous.  M 


P  p  14 

Nous  jr  trouvons  1* abris  que  nous  dev ions  que  nous  cherchions. 
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Avant  tout  a  coup  de  grosses  gouttes  commencent  a  tomber 
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et  nous  sommes  tres  fiers  d*etre  a  1* abris  de  cet  orage.  (113)  MSF 
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P 

Les  tricheurs  en  classe  posent  des  problemes  a  leurs  leurs 
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23 

autres  compagnons  et  aussi  aux  professeurs.  Ma intenant ,  quelle 


P  %  %13 

est  la  solution  a  ce  probleme?  Est-ce  qu*il  faut  les 


P  P  p  14 

ddnoncer  ou  faire  comme  ils  font  eux  aussi?  Si  nous  lesv 


P  P  P 

^denoncons .  nous  nous  courons  le  risque  de  ne  pas  etre  airod  par 


P  p  37 

eux  ou  de  briser  la  solidarity  de  l^ouioe  oue  la  classe  forme* 


P  P  6  p 

Alors,  qu#est-ce  qu#il  faut  faire?  II  faut  leur  montrer  que 


P  P  P 

nous  savons  qu'ils  trichent  et  essayer  par  divers  gestes  et 

9  9  9 

P  P 

autres  mdthodes  de  leur  montrer  le  mal  oui  existe  dans  cette 
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ro4thode  d*emploi  en  classe.  Ma intenant  le  tricheur  ne  peut«i 
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p  16 

vetre  ne  nous  dcoutera  pas.  Mais  au  mo ins  nous  essaierons 
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par  not re  exemple  de  les  diriger  dans.  (127) 
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Avant  cPenvi sager  une  semaine  de  camping  vous  devez  etre  pret  F 


P  25  ^p 

a  faire  face  a  tous  ces  obstacles.  Ces  obstacles  peuvent  etre  SFM 


la  pluie,  le  vent,  les  moustiques,  les  animaux  sauvages.  et  M 


22 


ainsi  de  suite.  Aussi  vous  devez  etre  pret  a  savoir  comment  MF 


P  P  27 

faire  un  feu  et  comment  resister  aux  bruits  environnants.  Ces  M 


aP  P 

bruits  peuvent  etre  des  automobiles,  des  trains  qui  passent . 


p  23 

des  g arsons  qui  se  disputent.  et  autres  choses.  Aussi  vous 


SMM 


devez  penser  a  toutes  les  choses  que  vous  devez  apporter  pour  M 


25  p 

cette  semaine  de  camping.  Votre  auto  peut  etre  tres  encombr4  F 


p  20 

si  vous  ne  choisissez  pas  vos  vos  effets  seulement  que  les 
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effets  que  vous  avez  except i one 11 ement  de  besoin.  Aussi  les 


SM 


Y  -  MV 

\  v_-;  r.  '■  •  -  S9Y.*fc  »iJOV  6'  .9rtiu3..ob  ia^ia 


<* 


,  'J;-f^88feC  a  .lb  WOfJ'OiOB  •  9b  99 its  ^vutvj  o  sit.* 'id 


' 


q 

.  -  ■ 


149 
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animaux  qui  approchent  votre  tente  peuvent  etre  tres  inconve-  S 
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nients  vous 
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avoir  1' 

1 ours . 
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peigne,  se  brosse  les  dents. 


*  p  16 

s’habille. 
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Ensuite  vient  le  temps 
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ox  9*  px  ox  ox 

du  dejeuner.  Elle  prepare  le  cafe  et  les  oeufs  pour  le  rest^  FF 

ox  17  ox  pox 

ant  de  la  famille*  Ensuite  apres  que  le  pere  part  pour  1* office.  FMSF 


*  *  p  o  x  oxx  op  24 

elle  se  voit  devant  la  vaisselle  et  d*autres  choses  a  faire.  FFS 

9 
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Elle  fait  les  lits,  nettoie  le  plancher,  fait  la  lessive, 


p  x  o  p  ox  23  x  o 
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x  opx  18  *  p  x 

ses  activitds  est  de  faire  le  magasinage.  Elle  achete  tous 

9  9 
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X  o  X  x  13 

les  bons  mets  pour  son  prochain  re pas. 
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3  p  10 

Le  desert.  II  y  a-t-un  homme  aui  marche  dans  le  desert. 


II  il 
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SF 


P  P  p  16 

a  soif,  son  chameau  est  fatigue,  et  il  vente  beaucoup.  L* homme  M 


P  P 

se  rend  sur  le  haut  de  la  col line  et  et  il  croit  apercevoir  un  FF 
5  4 

25  p 

etang  ou  une  source  d*eau.  Il  descend  la  colline  et  il  F 

9  9  1 

P  p  18  p 

s*aper$oit  que  son  jpgement  etait  faux.  Son  chameau  n*en  peut 


6  P  P 

pu.  Alors  il  se  repose  esperant  que  que  peut-etre  qu*il  va 
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pleuvoir.  (77) 
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P  P 

Je  suis  d* accord  avec  le  narrateur  qu*il  ne  faut  pas  ddnoncer  le  le  F 
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20  p  p 

tricheur.  La  classe  est  une  est  un  endroit  ou  que  qu1!!  faut  qu'il  S 

2  3 


p  26 

y  ait  un  atmosphere  de  ou  que  l«on  aide  un  a  l*autre. 
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Comme  profes-  SFF 
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seur  je  crois  que  le  professeur  doit  exiger  de  ses  Aleves  le 


27 

l*honnetet4  parmi  eux. 
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II  doit  aussi  voir  a  ce  que  les  les  eleves  FM 
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P  P  25 

n'aient  pas  le  chance  ou  ne  sMent  pas  tentes  a  tricher.  De  la 
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P  p 

part  des  eleves  il  faut  qu’ils  qu’ils  se  d&veloppent,  qu*  F 
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ils  aient  le  caractere  a  a  realiser  que  que  tricher  c'est  leur.  (110) 
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Le  camping. 


P  P 

II  y  a  beaucoup  de  difficulties  lorsq^on  fait\ 
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FS 


15  p  p  10 

^du  camping.  Lorsqu*on  quitte  peut-etre  qu*il  fait  du  soleil.  S 

P  ^  p  14 

Ce pendant  on  est  en  marche  et  il  commence  a  pleuvoir.  Rendu^  M 


p  P  16 

Na  notre  camp  il  y  a  la  difficulty  a  faire  le  feu. 


Ensuite  il  FSM 


p  6  ^p  11 

y  a  le  vent.  Aussi  les  maringouins  peuvent  badrer  beaucoup. 
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Une  autre  difficulty  sont  les  animaux  sauvages.  Les  un  ourson  MM 
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un  ours  peut  venir  manger  peut-etre  a  la  tente.  (76) 
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elle  brosse  ses  dents  et  elle  peigne  les  cheveux  de  son  petit  FM 
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enfant.  Ensuite  la  maman  retourne  ou  va  dans  la  cuisine  et  MMF 
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elle  met  son  tablier.  Elle  fait  rechauffer  le  cafe  et  prepare 
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le  dejeuner. 
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Papa  et  les  enfants  d^jeune  avec  la  maman  et 
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ensuite  le  papa  s'en  va  a  son  bureau.  Ensuite  la  maman.  (94) 
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m*en  a  souvent  parle. 
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les  sables  montent 
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ont  monte  dans  les  airs,,  II  regarda  autour  de  lui  et  il 
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WOC  -  mere  de  f ami lie. 

Pron  -  (1)  lever  (2)  faut  (3)  _  (4)  important  (5)  commence  (6)  commence 

(7)  ensuite  (8)  doit  (9)  f ami lie  (10)  cuire  (11)  _  (12)  _ 

(13)  cafd  (14)  heure  (15)  peut  (16)  _  (17)  bien  avant  (18) 

preparer  (19)  Ensuite  .  .  .  dejeuner.  (20) 
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le  sable  et  qui  pennettrait  peut°etre  d* avoir  des  unx 
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^peu  plus  de  vegetation.  Ca  serait  agreable  je  pense  bien 
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aussi.  (134) 
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puis  voir  a  ce  que  ces  eleves-la  assistent  si  vous  voulezv 
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donne  rien  parce  que  plus  tard  si  il  se 


P 

font 
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avoir  un  peu  de  difficulty  oh,  par  exemple  de  la  fume  qui  qui 
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pendant  la  cuisson*  Ensuite  le  les  gens  qui  partent  qui 
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hurlent  toute  la  nuit  iustement  qui  ont  des  petits  partvs^ 


toute  la  nuit  pendant  au^n  essaie  de  dormir  et  surtout  l’eau 
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ils  de  fait  ils  dtaient  Presque  ils  etaient  vraiment  inondes. 
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o  p  ox  42  o  *  p 

train  de  clapoter  avec  la  voisine.  Mais  il  existe  quandv  F 
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(13)  peut-etre  (14)  _  (15)  maintenant  (16)  _  (17)  pour  aider 

(18)  telephone  (19)  II  serait  .  .  .  autrefois.  (20)  _ 
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P  p  34  p  p 

vivent  s*il  v  en  a.  Ce  n®est  pas  tres  scientifique  mais  c*est 


p  15  P 

a  quoi  5a  me  fait  penser.  Ca  me  fait  penser  aussi  a  St. 


19  p 

Exup^ry,  son  petit  et  son  11  Pet  it  Prince. **  Ce  n*est  pas 

2  5 

P  P 

vraiment  un  orage  qu*il  v  a  dans  nLe  petit  Prince"  mais  c'est 


25  p 

un  orage  emotionel  plus  ou  moins.  Et  puis  c*est  dans  le 
9  5 

11  7 

desert  loin  de  tous  les  hommes.  Personne.  Le  soleil  brulant. 


P  P  8 

C*est  tout  c*est  tout  ce  oui  nous  entoure.  (144) 
4  "  ‘  . . 
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Je  suis  bien  d*accord  qu’il  ne  faut  pas  dire  ne  faut  pas 

5  2 

P  P  P 

rapporter  ceux  qui  trichent  mais  je  crois  tout  de  meme  que 


P  P 

ce  n*est  pas  tres  juste  de  voir  quelqu*un  qui  triche  et  puis 


P  33  p 

qui  a  des  notes  plus  hautes  que  nous.  Nous,  nous  dtudions 
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P  p  19 

nous  etudions  et  puis  les  resultats  sont  bien  mo ins  bons. 

9  5  1 


MMM 


P  P 

Mais  dans  un  autre  sens  c’est  vrai  aussi  qu’il  ne  faut 


FMM 


%  P  P 

que  l'atmosphere  peut  devenir  plus  tendue  mais  je  je  crois  que  M 
2  5  4 


vraiment  que  la  justice  doit  etre  faite  et  puis  je  crois  que  oui  M 

9 

P  P 

c’est  la  meilleure  c’est  une  meilleure  idde  de  dire  a  celui  qui^  MS 


> 


p  p  p 

triche  de  de  lui  dire  bien  qu’on  sait  qu’est-ce  qui  arrive  et  S 
4  9  5 


p  78  1 

puis  pourquoi  qu’il  a  des  si  bonnes  notes.  Mais.  (137) 

5 


MM 


15M  - 

15 

W  -  137 

4F  - 

8 

IC  -  29 

6S  - 

18 

VOC  -  139 
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P  -  23 

H  -  17 

VC  -  8  A  1 

p  P  a  P 

On  dit  t oui ours  que  faire  du  camping  c’est  c’est  d’etre 

4 

P  P 

au  paradis  mais  moi  je  crois  que  c’est  tout  le  contraire 


P  P  %  37 

parce  aue  vraiment  on  est  il  Peut  pleuvoir  a  verse.  Et 

1  2 

P  P 

puis  soit  que  le  lac  est  inond£  ou  bien  il  fait  tellement 
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.p  27  P 

soleil  qu’on  on  rotit  Presque  de  chaleur.  Ou  c'est  tout  le 
4 

P 

contraire,  il  fait  tellement  froid,,  vingt  sous  zero.  <guJor\\ 


p  16 


P  P 

Et  puis  c’est  sans  compter  les  moustiques,  les  fourmils. 


P 

les  les  les  mouches  oui  peuvent  nous  d6vorer  en  vie«  et  meme  les 
4  4 

p  38 

ours  oui  peuvent  nous  visiter  pendant  la  nuit.  Et  puis  je 


P  P 

me  souviens  aussi  une  fois  d’etre  d' avoir  couche  a* 

3 


^Saskatoon  avec  le  train  aui  passait  a  deux  heures.  a  trois^ 


38  p 

leures .  et  a  quatre  heures  de  la  nuit.  Et  tout  5a  c’est  sans 

1 


P  P 

compter  qu'il  faut  se  laver  dans  le  lac  et  puis  il  y  a 

9 


P 

faut  faire  faut  faire  notre  dtner  sur  un  feu  et  puis 


3  4 
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40 


salir 

toutes  les  casseroles  et 

puis. 
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VS  -  8  A  1 
x  Ox 


8 


P  x 


6  x 


La  journee  d*une  mere  de  f ami lie.  II  est  11  est  sept  heures.  La  FF 

!  4  5 


*  p  6  x  x  o  *  p  * 

mere  doit  se  lever.  La  premiere  chose  qu’elle  doit  faire  je 


M 


p  *  op  X  ox  oop  X 

crois  c*est  de  mettre  le  cafe  sur  le  feu  et  de  prendre  une 


p  32 


*  * 


tasse  de  cafd;  c*est  ce  qui  ravigote.  Et  puis  apres  ca  on 


FMF 


*  p  o  p  x  ox  22  o 

peut  se  laver  et  puis  prdparer  le  ddjeuner  du  mari.  Et  puis  apres «MFMM 


x 


o  p 


15 


P  x 


5a  sera  notre  tour  devoir  un  ddleuner.  Ensuite  c'est  la 


SM 


6  *  *  P  x  o  p 

vaisselle.  II  faut  faire.il  faut  faire  le  mdnage  et  puis  faire  M 

4 


X  X  p  X  O  X 

le  menage,  ouelquefois  la  lessive,  dtendre  le  linge  ou  le 


M 


o  x 


41 


faire  secher  puis  le  repasser  peut-etre  dans  1* apres -midi 


MMF 


*  * 


ox 


Et  entre  tout  ca  il  faut  s*occupper  des  enfant s  qui  doivent 


FMS 


p  oxl9  pox  opo 

partir  pour  la  classe.  Faut  s*occupper  du  b£bd  qui  crie  et 

-  ! 


SFS 


op  *16*  *  opx 

qui  a  faim  lui  aussi.  II  faut  s*occupper  de  faire  le  souper. 


SM 


op  14 

d*ecrire  peut-etre.  (150) 
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13M  ■ 

-  13 

W 

-  150 

WOC 

-  4 

9F  • 

-  18 

IC 

-  30 

P&C 

-  27 

5S  • 

*  II 

VOC 

-  171 

Det 

-  21 

T 

46 

P 
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Pro 

-  19 

H 

3 

Pron 

-  16 

WOC  -  mere  de  famille,  dejeuner  du  marl,  le  faire  secher,  le  repasser. 

Pron  -  (1)  cafe  (2)  tout  (3)  _  (4)  preparer  (5)  ensuite  (6)  ensuite 

(7)  puis  (8)  doit  (9)  famille  (10)  tour  (11)  vaisselle  (12)  _ 

(13)  tout  (14)  heures  (15)  faut  (16)  _  (17)  il  est  (18)  occupper 

(19)  II  faut  .  .  .  midi.  (20) 


OS  -  9  A  1 

P 

L*auteur  de  ce  sketch  a  surement  oublie  de  parler  de  l'effet 


p  26 

oue  causait  la  pluie  tombante  sur  le  sable.  La  pluie  en 


P  P 

arrivant  sur  le  sable  se  changeait  surement  en  vapeur  d*eau 


p  30  p 

etant  donne  la  haute  temperature  des  sables.  II  a  omis  aussi 

. — . - . -■ .  - .  '  -  1 

p  23 

de  faire  allusion  au  paratonnerre  place  sur  le  haut  des  dunes. 


enf in  a  mon  avis,  etant  donne  que  de  gros  courants  d*eau^ 
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P  p  24 

se  forment  le  desert  se  deplace.  Or  il  ne  serai t  pas  sage 
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p  P 

de  prddire  tout  ce  qui  peut  arriver  lorsq^un  d4sert  se> 

1  5 


SS 


p  23 

.deplace.  (94) 
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7M  -  7 
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9F  -  18 

IC  -  50 

8S  -  24 

VOC  -  126 

T  49 

P  -  15 

H  -  4 

OC  -  9  A  1 

p  p  p  10 

Qui  dit  tricheur,  dit  menteur,  dit  voleur. 


Je  ne  serais  pas 


d'avis  moi  non  plus  de  favoriser  les  rapporteurs  car  enfin  le.  FS 

1 

p  33 

^tricheur  ne  nuit  pas  a  la  societe.  Et  en  second  lieu  eh  bien  FM 


d* autre  part  par  1  Experience  le  tricheur  apprendra  qu’il  est 
5  1 


FMF 


P  ^  P 

plus  convenable  de  travailler  par  soi-meme  afin  d* arriver  a 


MSFS 


43  p 

de  bons  resultats.  II  est  deplorable  toutefois  que  le  tricheur  MM 

1  1 


P  20 

en  general  soit  favorise.  Que  certains  eleves  du  a  uri 

9  1 


FMS 


J>esoin  moment and  ait  a  tricher  et  immanquablement  se  fasse 


MM 


p  30  p  6 

prendre  sur  le  fait.  Je  ne  sais  pas  mais  tricher.  (97) 
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8M  -  8 

W  -  97 

7M  -  14 

IC  -  35 

4S  -  12 

VOC  -  142 

T  34 

P  -  14 

H  -  8 

VC  -  9  A  1 

P  ,  13 

Le  camping  est  un  sport  tres  interessant.  Mais  par  contre 


P  P 

malgr£  les  economies  qu*!!  nous  permet  de  realiser  je  crois 
9  1 

P  29 

qu*il  nous  off  re  maints  inconvenients.  En  effet  tout  comme 


.la  maison  a  sur  en  temps  de  camping  c’est  encore  la 
3  3  - 1 

P  P 

femme  qui  doit  voir  a  tout.  voir  a  ce  que  les  enfants  soient 


p  p  49 

bien  habilles  pour  une  iournee.  je  ne  sais  pas9  plutot  froide. 
"  x - 

p  .  15 
Ce  qui  arrive  tres  souvent  malheureusement  en  camping.  De\ 


> 


p  %  P 

plus  c*est  encore  a  la  femme  qu*il  va  appartenir  de  nettoyer 

1 


26  p 

les  chaudrons  noircis  sur  le  feu,  Et  encore  qui  verra  le 

-  1 

p  ,  P 

soir  venu  a  bien  organiser  chacun  de  ses  enfants  dans  la^ 
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p  30 

'tente  afin  qu*ils  n*aient  pas.  (119) 


F 


FS 


MFF 


FFM 


SS 


FM 


FMMFF 


M 


FFM 


FF 


MTi 


•  ....  sal  J/rl.esia 


[a  mi  3e*»  2/Uqnt3!>  *1 


J  U  .  2  ~  A’ . 


>  ;  *  !.i  -Li  ..  iXJL 


q 

,  s  ■  -,i  .  5.  •  ■  ^  5  **l  ™  iIJ:} 


t  i  '  In  .1  A  BV  a«r»®S  a  l  c.  ,  ■i'.'J;.':  3 °  ££&( 

<  •*:»  -  ..  ;  |  .  A  aL  n bt'*  :  >  af?* 


•  eaq  ^naia'n  ali’up  nl5a 


171 
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VS  -  9  A  1 

*  P  o  o  op 

Je  ne  suis  pas  tout  a  fait  en  mesure  de  juger  personnel lement 

1  1 

X  ox  o  o  o  *  *  p  o  X 

le  travail  d*une  mere  de  famille  mais  si  ie  me  base  sur  des 

o  x  *  o  x  *  o  pox 

temoignages  de  1  * un  de  mes  amis  eh  bien  il  va  sans  dire  que  la 

ox  p  59  *  *  *  * 

femme  a  la  maison  ne  fait  absolument  rien.  Je  me  je  me 

4 

p  *  o  P 

demande  tres  souvent  pourquoi  alors  elle  cherche  tant  a  obtenir 

x  ox  x31oxx  x 

une  egalite  dans  le  niveau  social.  D*apres  ce  meme  ami  la 


p  x  opxo  ox 

femme  passerait  ses  journees  a  rester  assise  en  face  de  son 

5 - 

o  o  p  o  o  p  o 

poste  de  television,,  a  placoter  au  telephone „  a  laser  de  ci 


o  oopx  o  p  ox 

de  la,  et  a  perdre  son  temps  a  aller  courir  chez  les  voisines 


oopoox  66  *  p 

et  a  parler  de  d*autres  personnes.  II  reste  toutefois 
5 


x  o  x  p  o  x  15 

des  statistiques  qui  nous  prouve  bien  que  la  femme.  (130) 
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10M  - 

•  10 

W 

-  130 

WOC 

-  8 

16F  • 

■  32 

IC 

-  55 

P&C 

-  36 

10S  - 

•  30 

voc 

-  171 

Det 

-  20 

T 

72 

p 

*»  16 

Pro 

-  12 
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7 

Pron 

=  14 

WOC  -  mere  de  families  ne  pas9  me  base,  ne  fait,  me  demande,  pourquoi 
elle  cherche,  niveau  social,  poste  de  television. 

Pron  -  (1)  juger  (2)  tout  (3)  _  (4)  demande  (5)  sans  (6)  souvent 

(7)  suis  (8)  temoignage  (9)  travail  (10)  dire  (11)  _  (12)  _ 

(13)  telephone  (14)  _  (15)  temps  (16)  _  (17)  une  egalite 

(18)  absolument  (19)  D*apres  .  .  .  per sonnes.  (20)  _ 

OS  -  10  A  1 

p  ^  12 

Un  orage  dans  le  desert  est  tres  impress ionant .  Les  elements  FM 


p  a  10  a  P 

se.  Les  vents  se  dechenent.  Les  betes  sont  tres  sensibles 
7  1  9 


M 


aux  signes  precurseurs  de  1* or age  et  el les  annoncent  par  la  meme  FMFF 
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signes  de  1* or age  arrive. 


Le  vent  devient  pire  et  le  ciel 

9  1  9 


pH  p 

devient  noir.  Le  vent  devient  tres  fort  et  nos  vetements  est 
9  9  9  9  1 


12 

pres. 


(34) 


3M  -  3 


W  -  34 


2F  -  4 
OS  -__0 
T  7 


IC  -  21 
VOC  -  43 
P  -  5 


OC  -  5  A  2 


H 


Les  eleves  dans  la  salle  de  classe  est  coirane  une  (community) 
1  1  9 


p  25 

et  ces  eleves  doivent  preserver  leur  solidarite.  Dans  toutes1 
1  1  1  - 


vLes 

p  6  p 

choses  qu’ils  font.  C*est 

2 

tout. 

(27) 

1  9 

1M 

-  1 

W 

-  27 

3F 

-  6 

IC 

-  37 

IS 

~_3 

VOC 

-  33 

T 

10 

P 

-  4 

H  -  9 


VC  -  5  A  2 

6  p  8 

Les  problemes  du  camping.  Le  premier  probleme  est  le  temps. 
11  1 


FMM 


F 


M 


FF 


FM 


S 


FM 


1 


■ 


■ 


MM'S 


,f -Mi p loLfj)  Jnajpgjn.i, 


JeiD  si  3s  eilq  ^nslvob  3 nov  si 


M 


t 


(^€)  .!»>iq 


; 


a  -  « 


* 


M(U)  *31/03  3e.  '3  *3no3t  a  It*  UP 


31 


£€  -  30V 


€_-  21 


**  e?.ja 


189 


P  p  13  p 

Quand  vous  d^slrez  aller  le  temps  ne  fait  pas  beau;  il  pleut 
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traiter  quelque  chose  comme  ceci .  Peut-etre  il  faut  etre.  (62)  MF 
1  1  5 


4M 

-  4 

W 

-  62 

3F 

-  6 

IC 

-  16 

OF 

-_0 

VOC 

-  67 

T 

10 

P 

-  8 

H 

• 

ro 

o 

VC  -  6  A  2 

P  4  p  p 

J’airae  le  camping.  Quand  i^tais  un  Bov  Scout,  j’en  ai  fait  S 


11  p 

beaucoup  mais  j'aime  le  camping  beau  plus  pendant  , 

11  1  3  1  1 

P 

^1  *£te  parce  que  dans  Shiver  il  fait  trop  chaud  pour  moi  mais 


FM 


SFMF 


aussi  dans  dans  l*4t6  il  y  a  trop  de  trop  de  moustiques  et  mouches  MFF 
4  5  4 


p  43  p  P 

qui  m 1 ennui ent.  Mais  j*aime  bien  etre  dans  la  foret  et  dcoute 
“ .  1  11  . . 

P  P 

les  oiseaux  chante  et  voir  les  Corneilles  et  les  lapins  et 


1  1 


1  5 


SMF 


tous  les  animaux  et  reptiles  dans  leur  habitat  naturel  mais.  (86)  MFM 

1  1  1 


6M  - 

.  6 

W 

-  86 

7F  - 

•  14 

IC 

-  34 

3S  - 

•  _9 

VOC 

-  100 

T 

29 

p 

o 

H 

1 

H 

-  20 

19 X 


' 

i 


sa  -  * 

' 

<1 


A  -  H* 


HI 


OS  -  H 


: 


LJ>JL. .11 

.  '  \  j  c  I 


XI 


...  )C  •  .  '  -x  c».l  qt/ooi/aod 


'-x. 


■  '  =  l  ~  *  e  a 


■  b  y  .oy  id  8.UM 

■j  .....  • 

e  x 


. 


ox  - 


■ 


d  -  Md 


192 


VS  -  6  A  2 

P  p  10 

II  est  six  heures  moins  cinq;  le  r4veil  sonne.  Madame 


P  P  9  p 

Thibaut  se  leve  et  se  lave*  Apres  elle  se  brosse  les  dents 

1  1 

11  P  P 

et  les  cheveux.  Apres  elle  elle  s’habille  et  fait  et 
114  9 


M 


M 
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a  Banff  et  et  il  y  a  des  animaux  de  de  forets*  Le  nous 
4  4  3 


p  P  !6 

demeurons  par  ter re  et  il  fait  froid  a  Banff  en  ete  et*  (78) 


MFF 


4M  -  4 

7F  -  14 
IS  -  __3 
T  21 


W  -  78 
IC  -  27 
VOC  -  98 
P  -  11 
H  -  18 


VS  -  1  B  2 


*  *  4  % 

C’est  le  matin  et  la  mere  la  mere  se  r^veiller  a  sept\ 

1  4  1 


F 


w 

■  • 

II  - 


<?  AS 

•r  <SJ-;  V  -f r  •  "  •  -S  ■.  .  ...-v.;  -  ...  •  ■  i  i 

9 


. 


■hm  (8t) 


81 

•  O  .  '.S  ,  ■  ..1  1  I  J  ,  ,g.; 

q  q 

-  -  -  '  ?.  l.  HI  t  '*  ■  7  Tia  21/0/1  3nftb/i»qao  3d 

■«.  i 

•*,  ••  ’  '  ?t  £tb  *  rr  s  o  f  v  i  Jo  T:.rn^  l 

<\ 


V 

‘  '  -  3»  V 
ii  -  q 
81  -  H 


A  -  MA 

-  21 


S  /  .  -  £<■■ 


V'' 


206 


16  p  p 

heures.  Elle  fait  sa  toilette  et  fait  fait  le  caf£  pour  le 
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dejeuner  pour  sa  f ami lie*  Son  mari  va  au  bureau  et  l*41eve 
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II  n*y  a  pas  de  bruit. 
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Ensuite  je  m,ecoute  que  mon  que 
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mon  pere  se  leve.  II  vient  avec  mol .  Nous  marchons  un  peu. 
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Quand  on  va  au  camping  il  ne  faut  il  ne  fait  j amais  beau. 
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Il  peut-etre  il  pleut,  peut-etre  il  fait  froid.  Surtout 
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le  le  vent.  Il  ya  il  y  a  tou jours  des  insectes  qui  vous  pjquent  MS 
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de  gens,  beaucoup  de  bruit.  Vous  ne  pouvez  pas  dorme  dormir. 
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lave,  elle  brosse  les  dents,  elle  se  peigne,  elle  s*habille. 
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beaucoup  de  hasards.  Le  premier  probleme  est  le  temps.  Le 
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camping  est  bon  quand  vous  quand  vous  avez  le  le  temps 
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beau.  Mais  quelquefois  le  temps  ne  n’est  pas  bon  beau,  Un 
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jour  un  jour  le  temps  il  peut  pleut;  un  jour  il  fait 
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Une  mere  est  une  femme  tres  tres  pressee.  Elle  se  leve  FM 
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le  matin  elle  se  leve  de  bonne  heure  le  matin  et  puis  elle  FFM 
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doit  lever  leurs  enfant s  leurs  enfants.  II  faut  pr4 parer 
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le  petit  le  petit  dejeuner  pour  les  enfants  et  pour  MF 

4 


25  p 


et  pour  le 

mari 

.  Et  puis  auand 
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commence*  Je  vais  au  au  campagne  et  je  vois  des  antilopes  et 
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Le  tricheur.  Le  tricheur  est  un  est  un  personne.  Le 
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tricheur  est  un  probleme  dans  dans  cette  classe. 
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Elle  se  leve,  elle  elle  se  lave,  elle  brosse  ses  dents  et  elle 
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(7)  puis  (8)  toilette  (9)  famille  (10)  pere  (11)  _  (12) 

(13)  pere  (14)  _  (15)  petit  (16)  _  (17)  famille  arrive 

(18)  _  (19)  Enfin  •  •  •  bureau.  (20)  _ 


OS  -  9  B  2 

7 

Un  orage  dans  le  desert.  Pres  de  cinq  heures  et  demie  du, 

1 

p  15  P 

, mat i n  je  vais  au  metro.  Alors  puis  puis  je  vais  a  mon  bureau 
>  g  9  3  4 

P  18  p 

et  je  fais  tout  mon  travail  le  jour.  II  y  a  beaucoup  de  gens 

9  9 


13 

dans  les  rues  et  dans  le  mdtro.  A  la  fin  de  la  iournee 

9  9 


P  %  12 

j* arrive  a  la  maison.  (57) 

5  9 


4M  -  4 

11F  -  22 
OS  -  _0 
T  26 


W  -  57 
IC  -  46 
VOC  -  65 
P  -  5 

H  -  11 


PC  -  9  B  2 


P 


Dans  la  salle  de  classe  il  y  a  tou jours  un  ou  deux  tricheurs 

9  9 

p  25 

qui  prdsentent  une  probleme  au  professeur.  Les  tricheurs  ne 

1  9 


P 

les  sortes  de  probl ernes  que  les  que  les  tricheurs  prilsentent 


2 


4 


1 


FFF 


FMMMF 


MF 


FFFF 


F 


FFM 


S 


FS 


r 


M'i'i 


®V1tx*  elliraaiCVJ)  ” '•  (dX)  3i39Q  (CX)  (^X)  ®iaq  (£X) 

..  .  .  ;  ■  • ; 


A 


.  .  :  \  /  2  ■ 

■■■  ■  ■ 

'  8 1  ■ 

•*  .  .  u  '  '  ■  •  t  • 

:  •  r  •:  “.O',  •  '.!■■  •  ■•■■■= 


X 


Si. 

J  .  •  . 


9 


JS  ‘3 


XX  -  H 


L,  .I .  • 


;  -  ;  ...  ..  . .  -  ...... 

9 


es 

.  .  '  ■  -  . . 
' 


227 


que  ils  interrompent  l*ordre  de  la  lecon  et  ils  ne  ils  ne  fait  F 
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La  jour  nee  d*une  mere  de  f  ami  lie  est  tres  complexe.  Premier-^  FFMM 
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brille.  II  fait  chaud.  II  n'y  a  pas  un  souffle  d’air.  II 
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APPENDIX  G 

TWENTY  PRESELECTED  PRONUNCIATION  PROBLEMS 

1.  Diphthongization  of  / i/  or  /e/  in  a  final  unchecked  1. 

syllable;  si.,  fee. 

2.  Diphthongization  of  /u/  or  /o/  in  a  final  unchecked  2. 

syllable;  boue .  beau. 

3.  Production  of  /oe /  before  / j/  ;  feuille.  3. 

4.  Giving  /<9/  quality  to  vowel  in  position  of  unstressed  4. 

vowel  in  English;  support . 

5.  Intercalation  of  nasalized  consonants;  tomber .  penser.  5. 

6.  /E/  instead  of  /a/;  en,  cent.  6. 

7.  /w/  for  lyl  i  lui,  iuin.  7. 

8.  /oj/  for  /wa/  :  oie ,  fois.  8. 

9.  /I/  for  /j/  ;  fille.  travail.  9. 

10.  Non  acceptable  variety  of  French  / r/ .  10. 

11.  /z/  for  /s/  ;  dessert,  soixante.  ils  sont.  11. 

12.  /&  ♦  j/  for  /z  *►  j /  ;  lesion,  les  yeux.  12. 

13.  Aspiration  of  initial  /p,  t,  k/ .  13. 

14.  Pronunciation  of  /h/  for  h  aspir6  or  muet.  14. 

15.  Sounding  of  silent  final  written  consonant  which  is  15. 

not  normally  sounded. 

16.  Dropping  /oe/  before  h  aspire.  16. 

17.  Closed  syllables  or  open  juncture;  II  est  ouvert.  17. 

18.  Carry-over  of  English  stress  to  words  of  three  or  18. 

more  syllables;  apartement . 

19.  High  points  of  succeeding  phrases  in  the  ascending  part 

of  the  statement  each  higher  than  the  previous  one  19. 

i 

20.  Forbidden  liaisons  after  singular  noun.  20. 
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